Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.693478553s trace: https://jaeger.dev.storj.io/trace/588f79fa694594cd FAIL (2025-11-14 17:48:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== =true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.932591096 (129h39m25.484061557s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933009723 (129h39m25.484480184s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933494356 (129h39m25.484964807s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934013114 (129h39m25.485483575s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934466317 (129h39m25.485936778s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935075406 (129h39m25.486545867s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935713682 (129h39m25.487184143s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936281162 (129h39m25.487751614s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936764753 (129h39m25.488235204s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.937367801 (129h39m25.488838262s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938008171 (129h39m25.489478632s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938495690 (129h39m25.489966161s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938970403 (129h39m25.490440864s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.939634298 (129h39m25.491104759s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.940134230 (129h39m25.491604691s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:28.308719353 (129h39m26.860189814s) [upload=114132]: Next returned nil segment Nov 14 17:43:28.308727148 (129h39m26.86019761s) [upload=114132]: Waiting for error group managing segments... Nov 14 17:43:28.707535031 (129h39m27.259005502s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.729035453 (129h39m27.280505914s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.823870691 (129h39m27.375341152s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.831822353 (129h39m27.383292824s) [noise=true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.861922060 (129h39m27.413392521s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.872633908 (129h39m27.424104359s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.880731728 (129h39m27.432202189s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892293294 (129h39m27.443763745s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892630936 (129h39m27.444101397s) [noise=true , address=77.90.31.19:4857 , piece_id=Y4VKY7MVKOB5MTGR5BUY2JQHMVKSCUMFJDCHIO5ZVOIHTJRM7NRQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.898592309 (129h39m27.45006276s) [noise=true , address=77.90.31.13:4659 , piece_id=MBBCRIZJQAYI7SE3BBGNYGTXRRXLEITR43HSR23N3OB7YZO5GGRA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.912258492 (129h39m27.463728953s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.913089614 (129h39m27.464560076s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.917757704 (129h39m27.469228155s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925888257 (129h39m27.477358718s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925917503 (129h39m27.477387964s) [seg_pos={0 0}, upload=114132]: Segment reached optimal threshold of 14 pieces. Nov 14 17:43:28.926197866 (129h39m27.477668327s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1278Hwz624uAkvSY2xXZL7NTGcbgEKaPpJuBKp5cC53SW9g4HfQ): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926208055 (129h39m27.477678516s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926346128 (129h39m27.477816599s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124WMsnYaj19ZVofFQz8wmiDBf4XKneRuaZbCxMHyGjca92gmUD): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926366347 (129h39m27.477836808s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926642973 (129h39m27.478113424s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pJWhSLza8WaMuvvDwH4nae57UxQmfCdDvAkQ3v25MgPYHoZXx): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926669233 (129h39m27.478139694s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926750088 (129h39m27.478220549s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f1rdiK9aQoWLnj5pLCs2GN5daEiA1H9QLZfpyxUcFe38pCafr): protocol: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection Nov 14 17:43:28.926766629 (129h39m27.47823709s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926795143 (129h39m27.478265605s) [seg_pos={0 0}, upload=114132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Nov 14 17:43:28.926891808 (129h39m27.478362279s) [upload=114132]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 14 17:43:28.926898560 (129h39m27.478369022s) [upload=114132]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 14 17:43:29.233362448 (129h39m27.784832909s) [upload=114132]: Done uploading segments... Nov 14 17:43:29.233387626 (129h39m27.784858077s) [upload=114132]: Upload finished. err: <nil> Duration: 5.693509173s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.744374556s trace: https://jaeger.dev.storj.io/trace/588f79fa694594cd FAIL (2025-11-14 17:48:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== =true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.932591096 (129h39m25.484061557s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933009723 (129h39m25.484480184s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933494356 (129h39m25.484964807s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934013114 (129h39m25.485483575s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934466317 (129h39m25.485936778s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935075406 (129h39m25.486545867s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935713682 (129h39m25.487184143s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936281162 (129h39m25.487751614s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936764753 (129h39m25.488235204s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.937367801 (129h39m25.488838262s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938008171 (129h39m25.489478632s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938495690 (129h39m25.489966161s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938970403 (129h39m25.490440864s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.939634298 (129h39m25.491104759s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.940134230 (129h39m25.491604691s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:28.308719353 (129h39m26.860189814s) [upload=114132]: Next returned nil segment Nov 14 17:43:28.308727148 (129h39m26.86019761s) [upload=114132]: Waiting for error group managing segments... Nov 14 17:43:28.707535031 (129h39m27.259005502s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.729035453 (129h39m27.280505914s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.823870691 (129h39m27.375341152s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.831822353 (129h39m27.383292824s) [noise=true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.861922060 (129h39m27.413392521s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.872633908 (129h39m27.424104359s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.880731728 (129h39m27.432202189s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892293294 (129h39m27.443763745s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892630936 (129h39m27.444101397s) [noise=true , address=77.90.31.19:4857 , piece_id=Y4VKY7MVKOB5MTGR5BUY2JQHMVKSCUMFJDCHIO5ZVOIHTJRM7NRQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.898592309 (129h39m27.45006276s) [noise=true , address=77.90.31.13:4659 , piece_id=MBBCRIZJQAYI7SE3BBGNYGTXRRXLEITR43HSR23N3OB7YZO5GGRA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.912258492 (129h39m27.463728953s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.913089614 (129h39m27.464560076s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.917757704 (129h39m27.469228155s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925888257 (129h39m27.477358718s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925917503 (129h39m27.477387964s) [seg_pos={0 0}, upload=114132]: Segment reached optimal threshold of 14 pieces. Nov 14 17:43:28.926197866 (129h39m27.477668327s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1278Hwz624uAkvSY2xXZL7NTGcbgEKaPpJuBKp5cC53SW9g4HfQ): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926208055 (129h39m27.477678516s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926346128 (129h39m27.477816599s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124WMsnYaj19ZVofFQz8wmiDBf4XKneRuaZbCxMHyGjca92gmUD): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926366347 (129h39m27.477836808s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926642973 (129h39m27.478113424s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pJWhSLza8WaMuvvDwH4nae57UxQmfCdDvAkQ3v25MgPYHoZXx): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926669233 (129h39m27.478139694s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926750088 (129h39m27.478220549s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f1rdiK9aQoWLnj5pLCs2GN5daEiA1H9QLZfpyxUcFe38pCafr): protocol: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection Nov 14 17:43:28.926766629 (129h39m27.47823709s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926795143 (129h39m27.478265605s) [seg_pos={0 0}, upload=114132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Nov 14 17:43:28.926891808 (129h39m27.478362279s) [upload=114132]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 14 17:43:28.926898560 (129h39m27.478369022s) [upload=114132]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 14 17:43:29.233362448 (129h39m27.784832909s) [upload=114132]: Done uploading segments... Nov 14 17:43:29.233387626 (129h39m27.784858077s) [upload=114132]: Upload finished. err: <nil> Duration: 5.744411045s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.879774498s trace: https://jaeger.dev.storj.io/trace/588f79fa694594cd FAIL (2025-11-14 17:47:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== =true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.932591096 (129h39m25.484061557s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933009723 (129h39m25.484480184s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933494356 (129h39m25.484964807s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934013114 (129h39m25.485483575s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934466317 (129h39m25.485936778s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935075406 (129h39m25.486545867s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935713682 (129h39m25.487184143s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936281162 (129h39m25.487751614s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936764753 (129h39m25.488235204s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.937367801 (129h39m25.488838262s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938008171 (129h39m25.489478632s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938495690 (129h39m25.489966161s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938970403 (129h39m25.490440864s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.939634298 (129h39m25.491104759s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.940134230 (129h39m25.491604691s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:28.308719353 (129h39m26.860189814s) [upload=114132]: Next returned nil segment Nov 14 17:43:28.308727148 (129h39m26.86019761s) [upload=114132]: Waiting for error group managing segments... Nov 14 17:43:28.707535031 (129h39m27.259005502s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.729035453 (129h39m27.280505914s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.823870691 (129h39m27.375341152s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.831822353 (129h39m27.383292824s) [noise=true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.861922060 (129h39m27.413392521s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.872633908 (129h39m27.424104359s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.880731728 (129h39m27.432202189s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892293294 (129h39m27.443763745s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892630936 (129h39m27.444101397s) [noise=true , address=77.90.31.19:4857 , piece_id=Y4VKY7MVKOB5MTGR5BUY2JQHMVKSCUMFJDCHIO5ZVOIHTJRM7NRQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.898592309 (129h39m27.45006276s) [noise=true , address=77.90.31.13:4659 , piece_id=MBBCRIZJQAYI7SE3BBGNYGTXRRXLEITR43HSR23N3OB7YZO5GGRA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.912258492 (129h39m27.463728953s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.913089614 (129h39m27.464560076s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.917757704 (129h39m27.469228155s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925888257 (129h39m27.477358718s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925917503 (129h39m27.477387964s) [seg_pos={0 0}, upload=114132]: Segment reached optimal threshold of 14 pieces. Nov 14 17:43:28.926197866 (129h39m27.477668327s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1278Hwz624uAkvSY2xXZL7NTGcbgEKaPpJuBKp5cC53SW9g4HfQ): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926208055 (129h39m27.477678516s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926346128 (129h39m27.477816599s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124WMsnYaj19ZVofFQz8wmiDBf4XKneRuaZbCxMHyGjca92gmUD): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926366347 (129h39m27.477836808s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926642973 (129h39m27.478113424s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pJWhSLza8WaMuvvDwH4nae57UxQmfCdDvAkQ3v25MgPYHoZXx): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926669233 (129h39m27.478139694s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926750088 (129h39m27.478220549s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f1rdiK9aQoWLnj5pLCs2GN5daEiA1H9QLZfpyxUcFe38pCafr): protocol: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection Nov 14 17:43:28.926766629 (129h39m27.47823709s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926795143 (129h39m27.478265605s) [seg_pos={0 0}, upload=114132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Nov 14 17:43:28.926891808 (129h39m27.478362279s) [upload=114132]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 14 17:43:28.926898560 (129h39m27.478369022s) [upload=114132]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 14 17:43:29.233362448 (129h39m27.784832909s) [upload=114132]: Done uploading segments... Nov 14 17:43:29.233387626 (129h39m27.784858077s) [upload=114132]: Upload finished. err: <nil> Duration: 5.879804564s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.753364043s trace: https://jaeger.dev.storj.io/trace/588f79fa694594cd FAIL (2025-11-14 17:45:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== =true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.932591096 (129h39m25.484061557s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933009723 (129h39m25.484480184s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933494356 (129h39m25.484964807s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934013114 (129h39m25.485483575s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934466317 (129h39m25.485936778s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935075406 (129h39m25.486545867s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935713682 (129h39m25.487184143s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936281162 (129h39m25.487751614s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936764753 (129h39m25.488235204s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.937367801 (129h39m25.488838262s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938008171 (129h39m25.489478632s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938495690 (129h39m25.489966161s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938970403 (129h39m25.490440864s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.939634298 (129h39m25.491104759s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.940134230 (129h39m25.491604691s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:28.308719353 (129h39m26.860189814s) [upload=114132]: Next returned nil segment Nov 14 17:43:28.308727148 (129h39m26.86019761s) [upload=114132]: Waiting for error group managing segments... Nov 14 17:43:28.707535031 (129h39m27.259005502s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.729035453 (129h39m27.280505914s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.823870691 (129h39m27.375341152s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.831822353 (129h39m27.383292824s) [noise=true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.861922060 (129h39m27.413392521s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.872633908 (129h39m27.424104359s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.880731728 (129h39m27.432202189s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892293294 (129h39m27.443763745s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892630936 (129h39m27.444101397s) [noise=true , address=77.90.31.19:4857 , piece_id=Y4VKY7MVKOB5MTGR5BUY2JQHMVKSCUMFJDCHIO5ZVOIHTJRM7NRQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.898592309 (129h39m27.45006276s) [noise=true , address=77.90.31.13:4659 , piece_id=MBBCRIZJQAYI7SE3BBGNYGTXRRXLEITR43HSR23N3OB7YZO5GGRA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.912258492 (129h39m27.463728953s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.913089614 (129h39m27.464560076s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.917757704 (129h39m27.469228155s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925888257 (129h39m27.477358718s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925917503 (129h39m27.477387964s) [seg_pos={0 0}, upload=114132]: Segment reached optimal threshold of 14 pieces. Nov 14 17:43:28.926197866 (129h39m27.477668327s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1278Hwz624uAkvSY2xXZL7NTGcbgEKaPpJuBKp5cC53SW9g4HfQ): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926208055 (129h39m27.477678516s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926346128 (129h39m27.477816599s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124WMsnYaj19ZVofFQz8wmiDBf4XKneRuaZbCxMHyGjca92gmUD): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926366347 (129h39m27.477836808s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926642973 (129h39m27.478113424s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pJWhSLza8WaMuvvDwH4nae57UxQmfCdDvAkQ3v25MgPYHoZXx): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926669233 (129h39m27.478139694s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926750088 (129h39m27.478220549s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f1rdiK9aQoWLnj5pLCs2GN5daEiA1H9QLZfpyxUcFe38pCafr): protocol: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection Nov 14 17:43:28.926766629 (129h39m27.47823709s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926795143 (129h39m27.478265605s) [seg_pos={0 0}, upload=114132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Nov 14 17:43:28.926891808 (129h39m27.478362279s) [upload=114132]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 14 17:43:28.926898560 (129h39m27.478369022s) [upload=114132]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 14 17:43:29.233362448 (129h39m27.784832909s) [upload=114132]: Done uploading segments... Nov 14 17:43:29.233387626 (129h39m27.784858077s) [upload=114132]: Upload finished. err: <nil> Duration: 5.753392406s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.734435039s trace: https://jaeger.dev.storj.io/trace/588f79fa694594cd FAIL (2025-11-14 17:45:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== =true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.932591096 (129h39m25.484061557s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933009723 (129h39m25.484480184s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933494356 (129h39m25.484964807s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934013114 (129h39m25.485483575s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934466317 (129h39m25.485936778s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935075406 (129h39m25.486545867s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935713682 (129h39m25.487184143s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936281162 (129h39m25.487751614s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936764753 (129h39m25.488235204s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.937367801 (129h39m25.488838262s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938008171 (129h39m25.489478632s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938495690 (129h39m25.489966161s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938970403 (129h39m25.490440864s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.939634298 (129h39m25.491104759s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.940134230 (129h39m25.491604691s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:28.308719353 (129h39m26.860189814s) [upload=114132]: Next returned nil segment Nov 14 17:43:28.308727148 (129h39m26.86019761s) [upload=114132]: Waiting for error group managing segments... Nov 14 17:43:28.707535031 (129h39m27.259005502s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.729035453 (129h39m27.280505914s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.823870691 (129h39m27.375341152s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.831822353 (129h39m27.383292824s) [noise=true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.861922060 (129h39m27.413392521s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.872633908 (129h39m27.424104359s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.880731728 (129h39m27.432202189s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892293294 (129h39m27.443763745s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892630936 (129h39m27.444101397s) [noise=true , address=77.90.31.19:4857 , piece_id=Y4VKY7MVKOB5MTGR5BUY2JQHMVKSCUMFJDCHIO5ZVOIHTJRM7NRQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.898592309 (129h39m27.45006276s) [noise=true , address=77.90.31.13:4659 , piece_id=MBBCRIZJQAYI7SE3BBGNYGTXRRXLEITR43HSR23N3OB7YZO5GGRA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.912258492 (129h39m27.463728953s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.913089614 (129h39m27.464560076s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.917757704 (129h39m27.469228155s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925888257 (129h39m27.477358718s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925917503 (129h39m27.477387964s) [seg_pos={0 0}, upload=114132]: Segment reached optimal threshold of 14 pieces. Nov 14 17:43:28.926197866 (129h39m27.477668327s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1278Hwz624uAkvSY2xXZL7NTGcbgEKaPpJuBKp5cC53SW9g4HfQ): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926208055 (129h39m27.477678516s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926346128 (129h39m27.477816599s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124WMsnYaj19ZVofFQz8wmiDBf4XKneRuaZbCxMHyGjca92gmUD): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926366347 (129h39m27.477836808s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926642973 (129h39m27.478113424s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pJWhSLza8WaMuvvDwH4nae57UxQmfCdDvAkQ3v25MgPYHoZXx): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926669233 (129h39m27.478139694s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926750088 (129h39m27.478220549s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f1rdiK9aQoWLnj5pLCs2GN5daEiA1H9QLZfpyxUcFe38pCafr): protocol: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection Nov 14 17:43:28.926766629 (129h39m27.47823709s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926795143 (129h39m27.478265605s) [seg_pos={0 0}, upload=114132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Nov 14 17:43:28.926891808 (129h39m27.478362279s) [upload=114132]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 14 17:43:28.926898560 (129h39m27.478369022s) [upload=114132]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 14 17:43:29.233362448 (129h39m27.784832909s) [upload=114132]: Done uploading segments... Nov 14 17:43:29.233387626 (129h39m27.784858077s) [upload=114132]: Upload finished. err: <nil> Duration: 5.734464175s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.726439683s trace: https://jaeger.dev.storj.io/trace/588f79fa694594cd FAIL (2025-11-14 17:44:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== =true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.932591096 (129h39m25.484061557s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933009723 (129h39m25.484480184s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933494356 (129h39m25.484964807s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934013114 (129h39m25.485483575s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934466317 (129h39m25.485936778s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935075406 (129h39m25.486545867s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935713682 (129h39m25.487184143s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936281162 (129h39m25.487751614s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936764753 (129h39m25.488235204s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.937367801 (129h39m25.488838262s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938008171 (129h39m25.489478632s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938495690 (129h39m25.489966161s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938970403 (129h39m25.490440864s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.939634298 (129h39m25.491104759s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.940134230 (129h39m25.491604691s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:28.308719353 (129h39m26.860189814s) [upload=114132]: Next returned nil segment Nov 14 17:43:28.308727148 (129h39m26.86019761s) [upload=114132]: Waiting for error group managing segments... Nov 14 17:43:28.707535031 (129h39m27.259005502s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.729035453 (129h39m27.280505914s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.823870691 (129h39m27.375341152s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.831822353 (129h39m27.383292824s) [noise=true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.861922060 (129h39m27.413392521s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.872633908 (129h39m27.424104359s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.880731728 (129h39m27.432202189s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892293294 (129h39m27.443763745s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892630936 (129h39m27.444101397s) [noise=true , address=77.90.31.19:4857 , piece_id=Y4VKY7MVKOB5MTGR5BUY2JQHMVKSCUMFJDCHIO5ZVOIHTJRM7NRQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.898592309 (129h39m27.45006276s) [noise=true , address=77.90.31.13:4659 , piece_id=MBBCRIZJQAYI7SE3BBGNYGTXRRXLEITR43HSR23N3OB7YZO5GGRA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.912258492 (129h39m27.463728953s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.913089614 (129h39m27.464560076s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.917757704 (129h39m27.469228155s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925888257 (129h39m27.477358718s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925917503 (129h39m27.477387964s) [seg_pos={0 0}, upload=114132]: Segment reached optimal threshold of 14 pieces. Nov 14 17:43:28.926197866 (129h39m27.477668327s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1278Hwz624uAkvSY2xXZL7NTGcbgEKaPpJuBKp5cC53SW9g4HfQ): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926208055 (129h39m27.477678516s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926346128 (129h39m27.477816599s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124WMsnYaj19ZVofFQz8wmiDBf4XKneRuaZbCxMHyGjca92gmUD): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926366347 (129h39m27.477836808s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926642973 (129h39m27.478113424s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pJWhSLza8WaMuvvDwH4nae57UxQmfCdDvAkQ3v25MgPYHoZXx): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926669233 (129h39m27.478139694s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926750088 (129h39m27.478220549s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f1rdiK9aQoWLnj5pLCs2GN5daEiA1H9QLZfpyxUcFe38pCafr): protocol: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection Nov 14 17:43:28.926766629 (129h39m27.47823709s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926795143 (129h39m27.478265605s) [seg_pos={0 0}, upload=114132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Nov 14 17:43:28.926891808 (129h39m27.478362279s) [upload=114132]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 14 17:43:28.926898560 (129h39m27.478369022s) [upload=114132]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 14 17:43:29.233362448 (129h39m27.784832909s) [upload=114132]: Done uploading segments... Nov 14 17:43:29.233387626 (129h39m27.784858077s) [upload=114132]: Upload finished. err: <nil> Duration: 5.726471644s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.821991131s trace: https://jaeger.dev.storj.io/trace/588f79fa694594cd FAIL (2025-11-14 17:44:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== =true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.932591096 (129h39m25.484061557s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933009723 (129h39m25.484480184s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933494356 (129h39m25.484964807s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934013114 (129h39m25.485483575s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934466317 (129h39m25.485936778s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935075406 (129h39m25.486545867s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935713682 (129h39m25.487184143s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936281162 (129h39m25.487751614s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936764753 (129h39m25.488235204s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.937367801 (129h39m25.488838262s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938008171 (129h39m25.489478632s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938495690 (129h39m25.489966161s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938970403 (129h39m25.490440864s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.939634298 (129h39m25.491104759s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.940134230 (129h39m25.491604691s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:28.308719353 (129h39m26.860189814s) [upload=114132]: Next returned nil segment Nov 14 17:43:28.308727148 (129h39m26.86019761s) [upload=114132]: Waiting for error group managing segments... Nov 14 17:43:28.707535031 (129h39m27.259005502s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.729035453 (129h39m27.280505914s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.823870691 (129h39m27.375341152s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.831822353 (129h39m27.383292824s) [noise=true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.861922060 (129h39m27.413392521s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.872633908 (129h39m27.424104359s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.880731728 (129h39m27.432202189s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892293294 (129h39m27.443763745s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892630936 (129h39m27.444101397s) [noise=true , address=77.90.31.19:4857 , piece_id=Y4VKY7MVKOB5MTGR5BUY2JQHMVKSCUMFJDCHIO5ZVOIHTJRM7NRQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.898592309 (129h39m27.45006276s) [noise=true , address=77.90.31.13:4659 , piece_id=MBBCRIZJQAYI7SE3BBGNYGTXRRXLEITR43HSR23N3OB7YZO5GGRA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.912258492 (129h39m27.463728953s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.913089614 (129h39m27.464560076s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.917757704 (129h39m27.469228155s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925888257 (129h39m27.477358718s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925917503 (129h39m27.477387964s) [seg_pos={0 0}, upload=114132]: Segment reached optimal threshold of 14 pieces. Nov 14 17:43:28.926197866 (129h39m27.477668327s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1278Hwz624uAkvSY2xXZL7NTGcbgEKaPpJuBKp5cC53SW9g4HfQ): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926208055 (129h39m27.477678516s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926346128 (129h39m27.477816599s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124WMsnYaj19ZVofFQz8wmiDBf4XKneRuaZbCxMHyGjca92gmUD): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926366347 (129h39m27.477836808s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926642973 (129h39m27.478113424s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pJWhSLza8WaMuvvDwH4nae57UxQmfCdDvAkQ3v25MgPYHoZXx): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926669233 (129h39m27.478139694s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926750088 (129h39m27.478220549s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f1rdiK9aQoWLnj5pLCs2GN5daEiA1H9QLZfpyxUcFe38pCafr): protocol: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection Nov 14 17:43:28.926766629 (129h39m27.47823709s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926795143 (129h39m27.478265605s) [seg_pos={0 0}, upload=114132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Nov 14 17:43:28.926891808 (129h39m27.478362279s) [upload=114132]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 14 17:43:28.926898560 (129h39m27.478369022s) [upload=114132]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 14 17:43:29.233362448 (129h39m27.784832909s) [upload=114132]: Done uploading segments... Nov 14 17:43:29.233387626 (129h39m27.784858077s) [upload=114132]: Upload finished. err: <nil> Duration: 5.822022582s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 21.412080799s trace: https://jaeger.dev.storj.io/trace/588f79fa694594cd FAIL (2025-11-14 17:43:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== =true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.932591096 (129h39m25.484061557s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933009723 (129h39m25.484480184s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.933494356 (129h39m25.484964807s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934013114 (129h39m25.485483575s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.934466317 (129h39m25.485936778s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935075406 (129h39m25.486545867s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.935713682 (129h39m25.487184143s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936281162 (129h39m25.487751614s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.936764753 (129h39m25.488235204s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.937367801 (129h39m25.488838262s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938008171 (129h39m25.489478632s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938495690 (129h39m25.489966161s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.938970403 (129h39m25.490440864s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.939634298 (129h39m25.491104759s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:26.940134230 (129h39m25.491604691s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Uploading piece... Nov 14 17:43:28.308719353 (129h39m26.860189814s) [upload=114132]: Next returned nil segment Nov 14 17:43:28.308727148 (129h39m26.86019761s) [upload=114132]: Waiting for error group managing segments... Nov 14 17:43:28.707535031 (129h39m27.259005502s) [noise=true , address=64.49.13.138:4482 , piece_id=F7RIQMVY7JJ4JYHP3ELLYWJXHDVDAMXV2X4WFI4XEPAFECCJOW5Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.729035453 (129h39m27.280505914s) [noise=true , address=5.231.73.3:4005 , piece_id=RKYQMBKDH4ED3USXSLNOZ3XNW2NMBJGU6MYW4MMECDP4ZDNHNEAQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.823870691 (129h39m27.375341152s) [noise=true , address=145.79.227.7:4313 , piece_id=WOFI5TQ2VPB4TSY3AQOCFBBFGDADUXWEH3ACEK2ZGXLXIYVVAVTQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.831822353 (129h39m27.383292824s) [noise=true , address=145.79.227.24:4613 , piece_id=NTEWHVXHYHXL625G2K7LF5UFXDREMHOAM4VPYGVPXVTPIL3T6YYA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.861922060 (129h39m27.413392521s) [noise=true , address=145.79.227.15:4879 , piece_id=M7YCHEC44YBSTAV2POUWUBR3CMOJQKMJDA5QQPWP4EX332BHWORQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.872633908 (129h39m27.424104359s) [noise=true , address=145.79.227.33:4873 , piece_id=HBM6FDAXGSLSYDRWKQFSSP5YFUQ7UEIVLA3Z3N3JCVJGPLAAAO6Q, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.880731728 (129h39m27.432202189s) [noise=true , address=145.79.227.47:4297 , piece_id=VJYDTX4RCWLN6K5YBLTM4V7V3RECBABRN6SSKVQCFLAQVNYWETHQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892293294 (129h39m27.443763745s) [noise=true , address=145.79.227.39:4046 , piece_id=BNNJVVCSB35WBJ6XOIRYBAKORJUP5PKYZC7QZ75Z5AAGTQD4AWGQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.892630936 (129h39m27.444101397s) [noise=true , address=77.90.31.19:4857 , piece_id=Y4VKY7MVKOB5MTGR5BUY2JQHMVKSCUMFJDCHIO5ZVOIHTJRM7NRQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.898592309 (129h39m27.45006276s) [noise=true , address=77.90.31.13:4659 , piece_id=MBBCRIZJQAYI7SE3BBGNYGTXRRXLEITR43HSR23N3OB7YZO5GGRA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.912258492 (129h39m27.463728953s) [noise=true , address=45.91.116.8:4076 , piece_id=YOAG3RQBYN7P657HUJFBSLTTNVLK4VL5NHIGGW537KQZX2GKUSMQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.913089614 (129h39m27.464560076s) [noise=true , address=45.91.116.5:4327 , piece_id=CIGG6QKFAF26AM7OYJVLMMUWE4A63UGDC23TUKOYEPCAAKYTOXUQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.917757704 (129h39m27.469228155s) [noise=true , address=77.90.31.14:4675 , piece_id=GGYODPFIHDBX2EWYKVJOGN54GLRKO6LT4JOF256XIOGU53JABO4A, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925888257 (129h39m27.477358718s) [noise=true , address=45.91.116.7:4023 , piece_id=IFCLEJ7EO2OHS4WNWB3QJCAWNYCEDNWF5VLSH2CMWSHCXHXZ2FQA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: <nil> Nov 14 17:43:28.925917503 (129h39m27.477387964s) [seg_pos={0 0}, upload=114132]: Segment reached optimal threshold of 14 pieces. Nov 14 17:43:28.926197866 (129h39m27.477668327s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1278Hwz624uAkvSY2xXZL7NTGcbgEKaPpJuBKp5cC53SW9g4HfQ): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926208055 (129h39m27.477678516s) [noise=true , address=77.90.31.17:4776 , piece_id=5R52BQP4UF4UYYXJ63LBYU4PKGES67EK5GPGJJMOCHXV2HF2D2TQ, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926346128 (129h39m27.477816599s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124WMsnYaj19ZVofFQz8wmiDBf4XKneRuaZbCxMHyGjca92gmUD): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926366347 (129h39m27.477836808s) [noise=true , address=45.91.116.12:4247 , piece_id=RG7CNE77OXUFBCPA363CGSJ2CI3LBFIXZV44YKPHZKF4EFRKJMJA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926642973 (129h39m27.478113424s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pJWhSLza8WaMuvvDwH4nae57UxQmfCdDvAkQ3v25MgPYHoZXx): protocol: expected piece hash; context canceled; EOF Nov 14 17:43:28.926669233 (129h39m27.478139694s) [noise=true , address=45.91.116.5:4302 , piece_id=SOKXZQJUZGJ7YW2UIOE5UDMK2X6O7SGALIES5KIKV7SMNJRI4ZKA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926750088 (129h39m27.478220549s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f1rdiK9aQoWLnj5pLCs2GN5daEiA1H9QLZfpyxUcFe38pCafr): protocol: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35880->145.79.227.26:4664: use of closed network connection Nov 14 17:43:28.926766629 (129h39m27.47823709s) [noise=true , address=145.79.227.26:4664 , piece_id=DSLECGEGVINORH2DEYVDP2FN5HNZA3DNC2GOLXVTAXHJGQPGBPAA, seg_pos={0 0}, upload=114132]: Long tail cancellation due to optimal threshold Nov 14 17:43:28.926795143 (129h39m27.478265605s) [seg_pos={0 0}, upload=114132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Nov 14 17:43:28.926891808 (129h39m27.478362279s) [upload=114132]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 14 17:43:28.926898560 (129h39m27.478369022s) [upload=114132]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 14 17:43:29.233362448 (129h39m27.784832909s) [upload=114132]: Done uploading segments... Nov 14 17:43:29.233387626 (129h39m27.784858077s) [upload=114132]: Upload finished. err: <nil> Duration: 21.412132627s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.346850567s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:30:13 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.346881517s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.444151522s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:29:36 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.44418689s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.257729273s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:28:29 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.257756916s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.39333192s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:27:18 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.394190264s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.249698065s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:26:48 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.249727822s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.486640643s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:25:55 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.486670421s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.255382383s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:25:00 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.255401578s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.20687561s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:24:43 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.206907331s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 6.29295968s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:23:34 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.292988204s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.275019076s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:22:48 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.275119899s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.164903572s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:22:29 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.165048949s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.215708748s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:22:06 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.215738685s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.547446371s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:21:04 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.547658193s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.462406051s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:19:55 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.462434606s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.249073678s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:18:40 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.249091772s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.166967172s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:17:26 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.167015345s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.241942799s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:16:45 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.242047428s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.269585234s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:15:53 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.269613318s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.292183025s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:15:02 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.292218342s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.271021283s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:14:19 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.271045379s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.30870894s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:13:11 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.308736863s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.587475288s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:12:15 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.587512739s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.183931632s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:11:45 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.183953975s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.585284728s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:11:07 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.585316598s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.557028108s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:09:58 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.557861646s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.246206786s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:09:31 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.246263113s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.540564579s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:09:10 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.540584368s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.251954753s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:08:10 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.252004336s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.340495343s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:07:11 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.340691879s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.267666434s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:06:51 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.267693896s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.339445607s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:05:42 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.339475152s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.504520264s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:04:48 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.504548046s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.591195255s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:04:02 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.591236885s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.527802861s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:02:57 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.527831426s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.437057472s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:02:24 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.437089784s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.260602133s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:01:28 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.260631318s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.78029151s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:01:05 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.780316337s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 7.209755843s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 17:00:07 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 7.209786651s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.189364092s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 16:58:53 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.189393618s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.18351096s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 16:58:32 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.183537661s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 7.008485332s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 16:58:01 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 7.008966269s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.416292364s trace: https://jaeger.dev.storj.io/trace/61c5b1ad5bd6f6c5 FAIL (2025-11-14 16:57:36 UTC) orbiter warning: read tcp 188.166.225.170:59234->45.38.24.2:443: read: connection reset by peer Duration: 6.416323715s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)