Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.475798553s FAIL (2025-07-11 18:43:34 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.475828562s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.947309516s FAIL (2025-07-11 18:42:22 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.947336257s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.612445883s FAIL (2025-07-11 18:41:47 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.612471571s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.747462292s FAIL (2025-07-11 18:40:54 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.747488321s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.969468177s FAIL (2025-07-11 18:40:00 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.969493695s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.987989781s FAIL (2025-07-11 18:38:51 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.988015701s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.860464608s FAIL (2025-07-11 18:38:20 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.860490158s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.895948461s FAIL (2025-07-11 18:37:42 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.89596884s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.866396544s FAIL (2025-07-11 18:37:04 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.866417955s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.821936501s FAIL (2025-07-11 18:36:48 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.821966948s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.97290159s FAIL (2025-07-11 18:35:55 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.972928361s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.827760011s FAIL (2025-07-11 18:35:01 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.827798234s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.957485325s FAIL (2025-07-11 18:34:46 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.957505765s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.002723074s FAIL (2025-07-11 18:33:43 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 6.002748494s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.652789432s FAIL (2025-07-11 18:33:08 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.652818336s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.832933109s FAIL (2025-07-11 18:32:33 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.832961965s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.826609579s FAIL (2025-07-11 18:31:50 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.826640839s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.321789864s FAIL (2025-07-11 18:30:36 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 6.321818931s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.88257387s FAIL (2025-07-11 18:29:36 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.882601453s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.714332955s FAIL (2025-07-11 18:28:33 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.714358064s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.8297502s FAIL (2025-07-11 18:27:34 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.829773935s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.709686724s FAIL (2025-07-11 18:27:00 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.709718596s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.902418124s FAIL (2025-07-11 18:26:23 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.902443262s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.814431599s FAIL (2025-07-11 18:25:15 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.814456087s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.968340956s FAIL (2025-07-11 18:24:05 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.968366894s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.001572323s FAIL (2025-07-11 18:23:09 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 6.00162282s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.762358978s FAIL (2025-07-11 18:21:56 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.762386321s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.118258392s FAIL (2025-07-11 18:21:40 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 6.118286405s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.909140878s FAIL (2025-07-11 18:20:42 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.909167949s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.026048121s FAIL (2025-07-11 18:19:45 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 6.026076675s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.034451159s FAIL (2025-07-11 18:19:11 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 6.034481226s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.207979317s FAIL (2025-07-11 18:17:59 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 6.207998163s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.854755058s FAIL (2025-07-11 18:16:48 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.854782361s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.835136405s FAIL (2025-07-11 18:15:52 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.83516034s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.653705624s FAIL (2025-07-11 18:14:52 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.653729831s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.777497478s FAIL (2025-07-11 18:13:43 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.777518589s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.614257175s FAIL (2025-07-11 18:12:37 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.614285699s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.201923702s FAIL (2025-07-11 18:12:01 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 6.201949432s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.80842044s FAIL (2025-07-11 18:10:56 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.808448664s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.736298154s FAIL (2025-07-11 18:10:34 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.736323221s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.956657811s FAIL (2025-07-11 18:09:30 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.956684902s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.850131862s FAIL (2025-07-11 18:09:09 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.850157351s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.754640716s FAIL (2025-07-11 18:08:51 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.754665182s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.900894968s FAIL (2025-07-11 18:08:13 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.900914135s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.947312058s FAIL (2025-07-11 18:07:10 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.947339851s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.974705801s FAIL (2025-07-11 18:06:36 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.9747315s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.972126512s FAIL (2025-07-11 18:05:43 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.972153113s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.959488173s FAIL (2025-07-11 18:05:00 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 5.959513122s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.006210466s FAIL (2025-07-11 18:04:43 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 6.006225094s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.120709911s FAIL (2025-07-11 18:04:17 UTC) orbiter warning: ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== b.BatchRequestItem_ObjectBegin Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment... Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment. Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece... Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments... Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil> Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces. Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments... Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil> Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments... Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments... Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded Duration:* 6.120733607s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)