Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.239392529s FAIL (2025-09-02 16:36:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.239417077s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.658168452s FAIL (2025-09-02 16:35:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.658186177s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.309150365s FAIL (2025-09-02 16:35:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.30917949s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.131157651s FAIL (2025-09-02 16:34:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.131209479s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.354889566s FAIL (2025-09-02 16:34:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.354918921s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.136902137s FAIL (2025-09-02 16:33:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.136933518s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.266579961s FAIL (2025-09-02 16:32:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.26660552s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.155814686s FAIL (2025-09-02 16:32:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.155834484s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.364334908s FAIL (2025-09-02 16:31:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.364360367s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.009956809s FAIL (2025-09-02 16:31:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.009987779s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.513998516s FAIL (2025-09-02 16:30:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.514026199s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.212181746s FAIL (2025-09-02 16:29:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.212213096s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.565821864s FAIL (2025-09-02 16:28:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 6.565848825s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.967917549s FAIL (2025-09-02 16:27:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 5.967947356s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.930478424s FAIL (2025-09-02 16:26:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 5.930508871s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 4.047830559s FAIL (2025-09-02 16:26:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments... Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment... Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment. Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece... Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments... Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil> Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces. Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments... Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled Duration: 4.047855747s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.386823365s FAIL (2025-09-02 15:33:55 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.386849355s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 7.145008963s FAIL (2025-09-02 15:33:27 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 7.145034421s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.025982812s FAIL (2025-09-02 15:32:21 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.026010434s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.037687814s FAIL (2025-09-02 15:31:51 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.037720387s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.218858985s FAIL (2025-09-02 15:30:42 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.218882401s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 7.835350595s FAIL (2025-09-02 15:29:56 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 7.83537933s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.017785641s FAIL (2025-09-02 15:28:42 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.017806271s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.93061358s FAIL (2025-09-02 15:27:29 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 5.930637175s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 6.272382527s FAIL (2025-09-02 15:26:28 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.27240972s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.582160095s FAIL (2025-09-02 15:25:29 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.582187147s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.112223583s FAIL (2025-09-02 15:24:16 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.112254793s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.124272441s FAIL (2025-09-02 15:24:00 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.124299192s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.221812328s FAIL (2025-09-02 15:23:11 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.221838007s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.540615941s FAIL (2025-09-02 15:22:00 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.540646058s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.141417867s FAIL (2025-09-02 15:21:00 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.141446142s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.167179819s FAIL (2025-09-02 15:20:11 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.167208295s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.96767369s FAIL (2025-09-02 15:19:02 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 5.967702997s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.358436054s FAIL (2025-09-02 15:18:47 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.358456043s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.174913799s FAIL (2025-09-02 15:18:05 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.174946102s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.451706737s FAIL (2025-09-02 15:17:27 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.451728649s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.627760993s FAIL (2025-09-02 15:16:46 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.627795921s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.853449907s FAIL (2025-09-02 15:16:02 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.853476286s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.269484574s FAIL (2025-09-02 15:15:45 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.269516946s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.389541705s FAIL (2025-09-02 15:15:25 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.389573144s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.623994301s FAIL (2025-09-02 15:14:44 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.624026843s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.353176588s FAIL (2025-09-02 15:13:49 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.353202367s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.336780977s FAIL (2025-09-02 15:12:54 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.336801186s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.263578738s FAIL (2025-09-02 15:11:50 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.263604919s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.754310586s FAIL (2025-09-02 15:11:35 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.754338799s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.881750161s FAIL (2025-09-02 15:10:30 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 5.881777122s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.195972129s FAIL (2025-09-02 15:09:46 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.196000543s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.462928282s FAIL (2025-09-02 15:08:38 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.462952899s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 7.02293468s FAIL (2025-09-02 15:08:12 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 7.022963966s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.026744394s FAIL (2025-09-02 15:07:38 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Sep 2 14:48:19.906020750 (96h40m16.586216319s) [upload=85030]: Starting upload Sep 2 14:48:19.906087008 (96h40m16.586282577s) [upload=85030]: Done starting upload Sep 2 14:48:19.906194482 (96h40m16.586390072s) [upload=85030]: Uploading segments... Sep 2 14:48:19.906320664 (96h40m16.586516233s) [upload=85030]: Got next segment. Inline: false Sep 2 14:48:19.906364799 (96h40m16.586560368s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 2 14:48:19.906371051 (96h40m16.58656662s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 2 14:48:20.364904131 (96h40m17.0450997s) [seg_pos={0 0}, upload=85030]: Begin upload segment... Sep 2 14:48:20.364942564 (96h40m17.045138123s) [seg_pos={0 0}, upload=85030]: Done begin upload segment. Sep 2 14:48:20.364964516 (96h40m17.045160085s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365019481 (96h40m17.045215101s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365276424 (96h40m17.045471993s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365504640 (96h40m17.045700209s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365556219 (96h40m17.045751778s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365759127 (96h40m17.045954696s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.365921037 (96h40m17.046116606s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366058139 (96h40m17.046253708s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366241450 (96h40m17.046437009s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366324870 (96h40m17.046520439s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366564759 (96h40m17.046760328s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366582763 (96h40m17.046778332s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366778126 (96h40m17.046973695s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366821450 (96h40m17.047017019s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.366964002 (96h40m17.047159571s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:20.367083211 (96h40m17.04727878s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Uploading piece... Sep 2 14:48:22.119582635 (96h40m18.799778204s) [upload=85030]: Next returned nil segment Sep 2 14:48:22.119621590 (96h40m18.799817149s) [upload=85030]: Waiting for error group managing segments... Sep 2 14:48:22.403696120 (96h40m19.083891699s) [noise=true , address=77.90.31.10:4519 , piece_id=G6FO7OXFFEA466ITPKEL4AAS7QDU546SN4PHE2IZWTXJ4DQKY2AA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.407386601 (96h40m19.08758217s) [noise=true , address=45.91.116.13:4153 , piece_id=BTS3LLVU7BVE63D65O4XVEWVFBT44L2ZE45YH77EH4HNPSZKFIVQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.411738648 (96h40m19.091934217s) [noise=true , address=77.90.31.16:4733 , piece_id=DI44ZTMLTSG4I56ZOB2LV6FD372365BPO2PDDYFOLSKRF7PA3YFA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.416508134 (96h40m19.096703703s) [noise=true , address=77.90.31.13:4627 , piece_id=3R2E7ZX7JVXH3FKBNHTU24IDBKT77T6RXEJLDNVZ2SEQPOK5RWNQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.430188611 (96h40m19.11038418s) [noise=true , address=77.90.31.15:4699 , piece_id=6UR546J2SDRIO2CBG7HSFWL4LPEJLAFLGDNIGLU57QZDKJ57J4GA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.462947071 (96h40m19.14314264s) [noise=true , address=45.91.116.14:4191 , piece_id=W77OBFTRFUZCCDQU27AWGW47E6FHQEPFP44ZPQZAA2IAWWSPCNXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.478217439 (96h40m19.158412998s) [noise=true , address=45.91.116.4:4939 , piece_id=QTLWBGZPKYA3LAO4LAWCA7ENYOGZB6HP44Q3N2YWLWLMEHRKGAAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.496907912 (96h40m19.177103481s) [noise=true , address=104.36.82.7:4912 , piece_id=DP57ZU3OQEPDNJE447XHGYCAX6W7VI6QWS5KKBLYQQMK2K5CJ63A, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.513906307 (96h40m19.194101876s) [noise=true , address=104.36.82.9:4005 , piece_id=7JHGTHOXQF47GWDF76X6C3EHVZGYPHLODC7GG45V67VC4HAQ7G6Q, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.515337676 (96h40m19.195533245s) [noise=true , address=77.90.31.18:4805 , piece_id=K2MEBUPNIKFF5WA4EV5XCWZMM6A6O4WVLCCDPEJKYS23POM5EGKQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.543682230 (96h40m19.223877799s) [noise=true , address=77.90.31.14:4663 , piece_id=35YENA5IHSOHAMPQEQMKYYQGTFJNSZZMNNNTX26M327SFCPS5GHQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.557373296 (96h40m19.237568856s) [noise=true , address=45.91.116.5:4298 , piece_id=BZOYCOBMWFF4XIKKBI2IYDOIR5JTGOCMMOMVO3PDZ2LRAOR7NXAA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561699865 (96h40m19.241895434s) [noise=true , address=104.36.82.10:4079 , piece_id=4XTYL3C27Y3B6FH2UFVED6ECYTHPRKCVUMMI7T5OUFA5ZMAH3EXA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: <nil> Sep 2 14:48:22.561716898 (96h40m19.241912467s) [seg_pos={0 0}, upload=85030]: Segment reached optimal threshold of 13 pieces. Sep 2 14:48:22.561916189 (96h40m19.242111748s) [noise=true , address=45.91.116.8:4047 , piece_id=CI3V2M6BUL45BUFFIOQDO2NP2I2OO4YXPQCEZHKGDQW7ZMWCBZSA, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.561976785 (96h40m19.242172354s) [noise=true , address=45.91.116.6:4973 , piece_id=KV7JTDQY73LNAIXRHB3LWAMQXEIWMCLTHELKTKPQLMEGCZUY67JQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562016692 (96h40m19.242212251s) [noise=true , address=104.36.82.6:4874 , piece_id=STG5XIULL2BWUGUQA63GPOJIUOJCFXV4LH5PDS5YO3B27W2DQTMQ, seg_pos={0 0}, upload=85030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Sep 2 14:48:22.562029235 (96h40m19.242224804s) [seg_pos={0 0}, upload=85030]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 2 14:48:22.562116933 (96h40m19.242312502s) [upload=85030]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 2 14:48:22.562121862 (96h40m19.242317431s) [upload=85030]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 2 14:48:24.403783270 (96h40m21.083978839s) [upload=85030]: Done uploading segments... Sep 2 14:48:24.403802828 (96h40m21.083998397s) [upload=85030]: Upload finished. err: <nil> Duration: 6.026777797s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)