Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 430365 reports (Page 8266 of 8608)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
5.956657811s
FAIL (2025-07-11 18:09:30 UTC)
orbiter warning: 
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.956684902s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
5.850131862s
FAIL (2025-07-11 18:09:09 UTC)
orbiter warning: 
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.850157351s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
5.754640716s
FAIL (2025-07-11 18:08:51 UTC)
orbiter warning: 
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.754665182s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
5.900894968s
FAIL (2025-07-11 18:08:13 UTC)
orbiter warning: 
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.900914135s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
5.947312058s
FAIL (2025-07-11 18:07:10 UTC)
orbiter warning: 
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.947339851s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
5.974705801s
FAIL (2025-07-11 18:06:36 UTC)
orbiter warning: 
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.9747315s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
5.972126512s
FAIL (2025-07-11 18:05:43 UTC)
orbiter warning: 
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.972153113s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
5.959488173s
FAIL (2025-07-11 18:05:00 UTC)
orbiter warning: 
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.959513122s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
6.006210466s
FAIL (2025-07-11 18:04:43 UTC)
orbiter warning: 
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 6.006225094s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
6.120709911s
FAIL (2025-07-11 18:04:17 UTC)
orbiter warning: 
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 6.120733607s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
5.892780703s
FAIL (2025-07-11 18:03:51 UTC)
orbiter warning: 
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.892800822s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.000567244s
FAIL (2025-07-11 18:03:45 UTC)
orbiter warning: 
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732     , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910     , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007     , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804     , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971     , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765     , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186    , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222    , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263     , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113    , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259    , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878     , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518     , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261     , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838     , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839     , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 30.000582032s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
5.867611176s
FAIL (2025-07-11 16:45:18 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.867640994s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
6.158275848s
FAIL (2025-07-11 16:44:49 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 6.15830309s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
5.615480795s
FAIL (2025-07-11 16:44:30 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.615502787s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
6.063239042s
FAIL (2025-07-11 16:43:21 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 6.06326391s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
5.812349394s
FAIL (2025-07-11 16:42:37 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.81237784s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
5.787803816s
FAIL (2025-07-11 16:41:40 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.78783251s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
5.850861216s
FAIL (2025-07-11 16:40:56 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.850888357s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
5.719596344s
FAIL (2025-07-11 16:40:28 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.719622384s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
5.814615031s
FAIL (2025-07-11 16:39:23 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.814641811s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
5.556211453s
FAIL (2025-07-11 16:38:34 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.55625672s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
5.772004297s
FAIL (2025-07-11 16:38:07 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.772036039s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
5.717740493s
FAIL (2025-07-11 16:37:04 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.717770091s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
5.9278019s
FAIL (2025-07-11 16:36:32 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.927829482s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
5.682238052s
FAIL (2025-07-11 16:36:13 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.682291083s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
5.970188766s
FAIL (2025-07-11 16:35:35 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.970215526s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
6.15002414s
FAIL (2025-07-11 16:34:52 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 6.15005071s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
5.762380997s
FAIL (2025-07-11 16:34:01 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.762407888s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
5.702727931s
FAIL (2025-07-11 16:32:52 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.702766434s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
7.463500262s
FAIL (2025-07-11 16:31:42 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 7.463523737s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
5.958812602s
FAIL (2025-07-11 16:30:54 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.958836378s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
5.63940649s
FAIL (2025-07-11 16:30:23 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.639437018s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
5.735131546s
FAIL (2025-07-11 16:29:44 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.735166241s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
5.899031752s
FAIL (2025-07-11 16:29:27 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.89905705s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
5.78806221s
FAIL (2025-07-11 16:29:11 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.788089161s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
5.84512445s
FAIL (2025-07-11 16:28:48 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.845146932s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
5.81902169s
FAIL (2025-07-11 16:27:55 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.819049514s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
5.709368816s
FAIL (2025-07-11 16:27:13 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.709394303s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
5.645490209s
FAIL (2025-07-11 16:26:29 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.64551713s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
5.697809861s
FAIL (2025-07-11 16:25:30 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.697837975s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
5.578548166s
FAIL (2025-07-11 16:24:15 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.578574085s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
5.548196559s
FAIL (2025-07-11 16:23:23 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.548229102s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
5.713798262s
FAIL (2025-07-11 16:22:54 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.713824742s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
5.78513948s
FAIL (2025-07-11 16:22:14 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.785160509s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
7.504153655s
FAIL (2025-07-11 16:21:51 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 7.504176068s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
5.476031794s
FAIL (2025-07-11 16:20:37 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.476060089s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
6.5134745s
FAIL (2025-07-11 16:20:21 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 6.513503676s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
5.926745271s
FAIL (2025-07-11 16:20:00 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.926772493s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
5.71103456s
FAIL (2025-07-11 16:19:32 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
38h51m3.223405546s) [upload=350981]: Starting upload
Jul 11 16:01:28.452828785 (438h51m3.22347013s) [upload=350981]: Done starting upload
Jul 11 16:01:28.452909810 (438h51m3.223551145s) [upload=350981]: Uploading segments...
Jul 11 16:01:28.452996927 (438h51m3.223638262s) [upload=350981]: Got next segment. Inline: false
Jul 11 16:01:28.453025752 (438h51m3.223667077s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 16:01:28.453032895 (438h51m3.22367422s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 16:01:28.912867084 (438h51m3.683508419s) [seg_pos={0 0}, upload=350981]: Begin upload segment...
Jul 11 16:01:28.912914725 (438h51m3.68355606s) [seg_pos={0 0}, upload=350981]: Done begin upload segment.
Jul 11 16:01:28.912935725 (438h51m3.683577061s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.912999487 (438h51m3.683640812s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913289553 (438h51m3.683930878s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913439379 (438h51m3.684080714s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913560611 (438h51m3.684201946s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913773468 (438h51m3.684414803s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.913871977 (438h51m3.684513302s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914071779 (438h51m3.684713114s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914141883 (438h51m3.684783208s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914337698 (438h51m3.684979033s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914410316 (438h51m3.685051651s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914601803 (438h51m3.685243128s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914662620 (438h51m3.685303955s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914827314 (438h51m3.685468649s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.914871429 (438h51m3.685512754s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915038598 (438h51m3.685679933s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915076902 (438h51m3.685718237s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:28.915283166 (438h51m3.685924502s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Uploading piece...
Jul 11 16:01:30.021101521 (438h51m4.791742856s) [upload=350981]: Next returned nil segment
Jul 11 16:01:30.021120397 (438h51m4.791761732s) [upload=350981]: Waiting for error group managing segments...
Jul 11 16:01:30.300757294 (438h51m5.07139863s) [noise=true , address=79.127.205.233:4655  , piece_id=X4GERWRR574VZ6HXKHEAQJYNLUMDQCZONILSGT2ZEB3J45VF7GFA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.583706119 (438h51m5.354347484s) [noise=true , address=45.91.95.5:4010      , piece_id=HWUDCBKP6N2H4HWQX64LSJA4NAW2S7WQRXH4OT6TYZ4FFSTU5EKA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.692027524 (438h51m5.462668859s) [noise=true , address=104.36.82.36:4630    , piece_id=GOXDZ72VQ6UTYTUTI4V7DZOFKEJALPJUMM2VX5HFTVLT6GUDW24Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.697878217 (438h51m5.468519552s) [noise=true , address=45.91.95.3:4007      , piece_id=EJCBR3GWWDFENOADR2IYNAXERUFNJQNHG7EPKDBB6VSZ36QO5KUQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.698137344 (438h51m5.468778679s) [noise=true , address=104.36.82.44:4903    , piece_id=SGAPXXEQQJYCPOY2QJC6VCS5ZWG6QI7ZGRLNG67KPC3KOZEZYMNQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.727391857 (438h51m5.498033192s) [noise=true , address=104.36.82.19:4432    , piece_id=OFLIFQIS4NMSWCPP5OIFTWDOZ6WLSQX6EJ246RPKPV6QOL4LEDSQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.787499022 (438h51m5.558140357s) [noise=true , address=156.146.43.225:4464  , piece_id=IIAHGYZNGWHMYRZDKF5HSWDEDFZULJSA5CIFEMIF4N2L4IXN4YDA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.802930647 (438h51m5.573571972s) [noise=true , address=79.127.219.38:4025   , piece_id=U3HVY4CFJDCF6LRQQJY5UHMVNLVC6YQ73RSNNSXFFAUEDI3BFH2A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.833442878 (438h51m5.604084213s) [noise=true , address=104.36.82.18:4388    , piece_id=RVRYBVLDOD3UDJU74XXOOLCAL75ITEIJLHOEVRT6P3JBPA57G2CA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.834219714 (438h51m5.604861049s) [noise=true , address=45.91.116.10:4092    , piece_id=ZBLYVBYH7UNPGNQXLOLF6LCGBNBW3K43DF5A2C6GERUNL3FKYSWQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.852139300 (438h51m5.622780635s) [noise=true , address=77.90.31.11:4579     , piece_id=XH6TNN4ROW4FTQWQM3Q5CGWPXNM37DCWAQI42J3WL64TKOQFCVGQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.858550597 (438h51m5.629191932s) [noise=true , address=77.90.31.17:4795     , piece_id=NP426DTKY4NF4EIVZOT3E323P3DYHWAEIVOM23BKCKYWNTJPM54Q, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.863047761 (438h51m5.633689096s) [noise=true , address=77.90.31.19:4860     , piece_id=WN6E7PYHTVKWRNFFHSCGUILFJV36OCZ4RMJ7QPECA76MF3ROUMXQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864444604 (438h51m5.635085939s) [noise=true , address=77.90.31.21:4880     , piece_id=7Z5M3ETAOUSP3DZ5ZNODHKHYFWI72SVYIH7CLENCD2ZJ2KHNO5TA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: <nil>
Jul 11 16:01:30.864489400 (438h51m5.635130735s) [seg_pos={0 0}, upload=350981]: Segment reached optimal threshold of 14 pieces.
Jul 11 16:01:30.864612144 (438h51m5.635253469s) [noise=true , address=77.90.31.14:4683     , piece_id=2ZK54NJE53B6LH3N74CBNTYRDFQNTWTKBMY4HPJ7XMYK7RVTT2DA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cth5bdi5iAWhHcLxqN9c7GLdheS7SLQ3x5fEHG1MdgdXWFdD6): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864657912 (438h51m5.635299247s) [noise=true , address=45.91.95.4:4013      , piece_id=S5MIGFYV277CSZ4N3RPCOLP7DJHK2GWVHI6JIGOTYXK35LJMBI3A, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123BuVDjdLg6M5z6iq7vsFrKCsAahbS6VGz4HeqekYNPqFiNBfF): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864679984 (438h51m5.63532132s) [noise=true , address=104.36.82.35:4615    , piece_id=ZQQA2QCD3OB47OPGZLVL7Z5HH2ANUMN3DMMUUAOLE65B5PGQUUCQ, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NJ5w8pAWCudDA9Xs4ES7b2evnbscesd682wJDh2gMMZ3Jf2zc): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864738356 (438h51m5.635379691s) [noise=true , address=77.90.31.18:4825     , piece_id=LDVQISZNRKOXX2A7MD3VI7MS5P6DOICWPAPFNZW5UC5RRD2ZV5YA, seg_pos={0 0}, upload=350981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PqKyfFxfVKTGARbPqBcQL3Naqjdf5uR44PeLi3sJpu57dcm1x): protocol: expected piece hash; context canceled; EOF
Jul 11 16:01:30.864757492 (438h51m5.635398827s) [seg_pos={0 0}, upload=350981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 11 16:01:30.864815874 (438h51m5.635457209s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 16:01:30.864819802 (438h51m5.635461127s) [upload=350981]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 16:01:31.177097842 (438h51m5.947739178s) [upload=350981]: Done uploading segments...
Jul 11 16:01:31.177116929 (438h51m5.947758254s) [upload=350981]: Upload finished. err: <nil>
Duration: 5.711066552s core uplink us-select-1 us1-placement-20