Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.953037255s FAIL (2025-09-03 11:44:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 5.953061121s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.292979386s FAIL (2025-09-03 11:43:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.293015956s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 7.350037197s FAIL (2025-09-03 11:42:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 7.350062998s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.243120827s FAIL (2025-09-03 11:42:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.243152206s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.180649486s FAIL (2025-09-03 11:41:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.180677751s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.571958824s FAIL (2025-09-03 11:40:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.571986428s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.152627418s FAIL (2025-09-03 11:39:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.152645363s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.268810011s FAIL (2025-09-03 11:39:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.268837543s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.418678441s FAIL (2025-09-03 11:38:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.418712697s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.784135708s FAIL (2025-09-03 11:37:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 5.784166406s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.245577843s FAIL (2025-09-03 11:36:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.24560184s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.422168911s FAIL (2025-09-03 11:36:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.42219927s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.192643158s FAIL (2025-09-03 11:35:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.192672474s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.472125588s FAIL (2025-09-03 11:34:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.472150506s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.073793229s FAIL (2025-09-03 11:33:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.073821123s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.098386747s FAIL (2025-09-03 11:33:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.098415864s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.708668365s FAIL (2025-09-03 11:32:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.708701307s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.897875664s FAIL (2025-09-03 11:32:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 5.897903397s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.095036892s FAIL (2025-09-03 11:31:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.095065516s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.058119881s FAIL (2025-09-03 11:31:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.058143998s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 8.604158151s FAIL (2025-09-03 11:30:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 8.604211193s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.558869913s FAIL (2025-09-03 11:29:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.558892184s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.285212717s FAIL (2025-09-03 11:29:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.285239338s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.284193335s FAIL (2025-09-03 11:28:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.284225696s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.85145796s FAIL (2025-09-03 11:27:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 5.851523126s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.943005398s FAIL (2025-09-03 11:26:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 5.943032289s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.808173516s FAIL (2025-09-03 11:26:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 5.808203673s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.33715183s FAIL (2025-09-03 11:25:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.337197868s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.366105409s FAIL (2025-09-03 11:24:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.366133404s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.991153356s FAIL (2025-09-03 11:23:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 5.991179114s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.877209506s FAIL (2025-09-03 11:23:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 5.87724236s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.870321456s FAIL (2025-09-03 11:22:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 5.87034999s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.921930288s FAIL (2025-09-03 11:21:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 5.921959785s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.876795248s FAIL (2025-09-03 11:20:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 5.876823132s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.066658081s FAIL (2025-09-03 11:19:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.066684993s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.126723904s FAIL (2025-09-03 11:18:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.126751447s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.207979892s FAIL (2025-09-03 11:17:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.208008085s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.44411846s FAIL (2025-09-03 11:16:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.444160321s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.349638157s FAIL (2025-09-03 11:15:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.349665389s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.108860303s FAIL (2025-09-03 11:14:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.108889188s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.288376526s FAIL (2025-09-03 11:14:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.28840513s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.113604662s FAIL (2025-09-03 11:13:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.11363516s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.87228357s FAIL (2025-09-03 11:12:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 5.872313186s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.095320697s FAIL (2025-09-03 11:12:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.095348048s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.367987508s FAIL (2025-09-03 11:11:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.36801465s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.477559171s FAIL (2025-09-03 11:10:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 6.47758983s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002508957s FAIL (2025-09-03 11:10:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 3 11:09:47.801545155 (117h1m44.481740714s) [upload=102897]: Starting upload Sep 3 11:09:47.801605330 (117h1m44.481800889s) [upload=102897]: Done starting upload Sep 3 11:09:47.801819390 (117h1m44.482014949s) [upload=102897]: Uploading segments... Sep 3 11:09:47.801852593 (117h1m44.482048162s) [upload=102897]: Got next segment. Inline: false Sep 3 11:09:47.801876639 (117h1m44.482072208s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 3 11:09:47.801892189 (117h1m44.482087758s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 3 11:09:48.308374732 (117h1m44.988570301s) [seg_pos={0 0}, upload=102897]: Begin upload segment... Sep 3 11:09:48.308434307 (117h1m44.988629866s) [seg_pos={0 0}, upload=102897]: Done begin upload segment. Sep 3 11:09:48.308457421 (117h1m44.98865299s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308552663 (117h1m44.988748242s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.308897804 (117h1m44.989093373s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309018986 (117h1m44.989214555s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309223436 (117h1m44.989419005s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309401047 (117h1m44.989596616s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309534011 (117h1m44.98972958s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309687304 (117h1m44.989882873s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.309906283 (117h1m44.990101852s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310183685 (117h1m44.990379254s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310247486 (117h1m44.990443045s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310504007 (117h1m44.990699566s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310539374 (117h1m44.990734934s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310770247 (117h1m44.990965816s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.310790696 (117h1m44.990986275s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:09:48.311033952 (117h1m44.991229521s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Uploading piece... Sep 3 11:10:12.148517833 (117h2m8.828713402s) [upload=102897]: Next returned nil segment Sep 3 11:10:12.148538222 (117h2m8.828733791s) [upload=102897]: Waiting for error group managing segments... Sep 3 11:10:12.481953845 (117h2m9.162149444s) [noise=true , address=45.91.116.6:4974 , piece_id=6JTY6I7VY2V7AHPYYJYSDTZN4MNHMPCL4JIJGMLUA4GOR4ZSUSRQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:12.605022765 (117h2m9.285218334s) [noise=true , address=45.91.116.8:4048 , piece_id=Q4HAYFWDZOSS32S75OIR6HCXMY6ED5G24JGG2WRJDWJNA5DBKTAQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.269719067 (117h2m9.949914636s) [noise=true , address=45.91.116.7:4010 , piece_id=HXRBOCDAO55FS3M46GTUMTM7ZI2GDPGLGBB3WZODVODSZHDJDEDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.270294027 (117h2m9.950489596s) [noise=true , address=45.91.116.9:4261 , piece_id=H6OXXY7ZKAU24MTTSBPGCRJJ2LARKMF6A5UJDRX4SHAAERNESHLA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.293470936 (117h2m9.973666515s) [noise=true , address=45.91.116.11:4119 , piece_id=KBVH4OL37I5DALGWCVGPTZQ3M6H3CCILYENOP67RPTANHY2YQKCQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:13.410798900 (117h2m10.090994469s) [noise=true , address=45.91.116.10:4081 , piece_id=ILREL2AMUDML3YVQUDGR6V3ZDVFXSQ3IFCUIF5QAWTI7TLOTAGBA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.271802041 (117h2m10.951997611s) [noise=true , address=77.90.31.18:4805 , piece_id=PF6DNJX2UAQK57IPZ7YFF7TIH326N2IUMD4WXEJBDSVAD4Z3HJSQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.328154311 (117h2m11.00834988s) [noise=true , address=45.91.116.12:4226 , piece_id=HFJ6UI45GHCCWMNMITAEWEZ7NAUMEDLB635YNUMMXALJC7U4R5PA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.438232373 (117h2m11.118427942s) [noise=true , address=45.91.116.4:4940 , piece_id=MQFEWFUJPUGRKPOITHEDOEZHD7ZWRJEPQUNBWAXIMYRDZX2MT6RA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.457968006 (117h2m11.138163575s) [noise=true , address=104.36.82.5:4838 , piece_id=6F7NBNPOM4MOZ4U5WGBDLVDKLINUYDCHF6ZOJZBHQXTS3JLVYBWQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.460669055 (117h2m11.140864624s) [noise=true , address=77.90.31.19:4841 , piece_id=I5PM2SVTIHFMMPE5GZYE2SVGDAQQBAIRYG46JM3WCQU4UTTDEBPA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:14.594694200 (117h2m11.274889769s) [noise=true , address=77.90.31.14:4662 , piece_id=4HHAYOA7FTMRGPGSVWT7MGXNBTV72HJI3XURNM7G43YS2CZPYK2A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239406674 (117h2m11.919602243s) [noise=true , address=45.91.116.5:4297 , piece_id=SRLINCUHPTLBGV3RAA7A3B6KT35DQVJZEY3JU532CB465VLLYYIA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: <nil> Sep 3 11:10:15.239436230 (117h2m11.919631799s) [seg_pos={0 0}, upload=102897]: Segment reached optimal threshold of 13 pieces. Sep 3 11:10:15.239515452 (117h2m11.919711021s) [noise=true , address=45.91.116.4:4937 , piece_id=7KEE5SBIDKAHJ3DLLLZLIVX44SEOZZZFXVPBFIUWV6FKXEAAQC7A, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239584173 (117h2m11.919779742s) [noise=true , address=77.90.31.12:4590 , piece_id=BRSYBDS5K5VZ3HACLBPWL4LRHKTARPMTGL2E2CJBZSGDFNO6VRQA, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Sep 3 11:10:15.239661531 (117h2m11.9198571s) [noise=true , address=104.36.82.10:4079 , piece_id=WZSLF6MFUCEEF6YYYH5JQGFV2AEAFI6FSRKENL6T764MY6SH7QDQ, seg_pos={0 0}, upload=102897]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43946->104.36.82.10:4079: use of closed network connection Sep 3 11:10:15.239674776 (117h2m11.919870345s) [seg_pos={0 0}, upload=102897]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 3 11:10:15.239746674 (117h2m11.919942243s) [upload=102897]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 3 11:10:15.239751974 (117h2m11.919947543s) [upload=102897]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 3 11:10:15.618194967 (117h2m12.298390536s) [upload=102897]: Done uploading segments... Sep 3 11:10:15.618215085 (117h2m12.298410654s) [upload=102897]: Upload finished. err: <nil> Duration: 30.002528324s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.277074063s FAIL (2025-09-03 01:21:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.277101325s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.263971492s FAIL (2025-09-03 01:21:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.263993604s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.165156764s FAIL (2025-09-03 01:20:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.165188635s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)