Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.998647691s
FAIL (2025-09-02 17:13:37 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 1.998671426s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.26751521s
FAIL (2025-09-02 17:13:19 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.267546178s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.313693679s
FAIL (2025-09-02 17:12:16 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.313722834s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.422362855s
FAIL (2025-09-02 17:12:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.422406697s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.153286351s
FAIL (2025-09-02 17:11:33 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.153315066s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
8.93177161s
FAIL (2025-09-02 17:11:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 8.931866232s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.13262501s
FAIL (2025-09-02 17:10:47 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.13265084s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.574844711s
FAIL (2025-09-02 17:10:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.574871052s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.392092359s
FAIL (2025-09-02 17:10:10 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.392121523s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.506737436s
FAIL (2025-09-02 17:09:50 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.506764999s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
6.511227896s
FAIL (2025-09-02 17:09:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.511289543s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.316562047s
FAIL (2025-09-02 17:08:38 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.316608625s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
6.434679956s
FAIL (2025-09-02 17:08:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.434710654s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
6.184725877s
FAIL (2025-09-02 17:08:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.184751154s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.57847557s
FAIL (2025-09-02 17:07:44 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.57850175s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.452221239s
FAIL (2025-09-02 17:07:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.45231576s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.580251408s
FAIL (2025-09-02 17:07:19 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.580282017s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.279957363s
FAIL (2025-09-02 17:06:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.279990376s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.191121345s
FAIL (2025-09-02 17:06:14 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.191169347s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
6.070913506s
FAIL (2025-09-02 17:06:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.070977757s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.891396584s
FAIL (2025-09-02 17:05:25 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.891427744s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.041572327s
FAIL (2025-09-02 17:05:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.041603716s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.178004188s
FAIL (2025-09-02 17:04:45 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.178030437s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
6.026821448s
FAIL (2025-09-02 17:04:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.026844381s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.715771588s
FAIL (2025-09-02 17:03:34 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.715802717s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
6.079683251s
FAIL (2025-09-02 17:03:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.079709591s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.105663266s
FAIL (2025-09-02 17:02:56 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 2.105687934s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
6.055942669s
FAIL (2025-09-02 17:02:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.055970061s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.641061571s
FAIL (2025-09-02 17:01:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.641088542s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1.823591834s
FAIL (2025-09-02 17:01:45 UTC)
orbiter warning: operation: Commit uplink: metaclient: context canceled
Duration: 1.823616031s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
6.06079976s
FAIL (2025-09-02 17:00:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.060832222s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
6.945543954s
FAIL (2025-09-02 16:59:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.945571978s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
6.145507043s
FAIL (2025-09-02 16:58:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.145529455s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
6.276975555s
FAIL (2025-09-02 16:58:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.277037292s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
6.090293994s
FAIL (2025-09-02 16:57:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.090335593s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
6.145616268s
FAIL (2025-09-02 16:56:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.145645013s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
6.19077139s
FAIL (2025-09-02 16:55:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.190802379s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
6.210820755s
FAIL (2025-09-02 16:54:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.210842114s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.169622186s
FAIL (2025-09-02 16:53:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.169646111s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.998536813s
FAIL (2025-09-02 16:52:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 5.998562042s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.965460115s
FAIL (2025-09-02 16:51:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 5.965486275s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.924954946s
FAIL (2025-09-02 16:50:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 5.924984823s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
5.993365018s
FAIL (2025-09-02 16:49:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 5.993389294s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.95665725s
FAIL (2025-09-02 16:48:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 5.956699571s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
6.403883284s
FAIL (2025-09-02 16:48:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.403913633s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
6.068490582s
FAIL (2025-09-02 16:47:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.068519397s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
6.567058941s
FAIL (2025-09-02 16:46:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.56716317s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.024617829s
FAIL (2025-09-02 16:45:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.024654639s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.268967435s
FAIL (2025-09-02 16:45:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.268996802s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
6.43344578s
FAIL (2025-09-02 16:44:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context canceled
======LOGS======
Sep 2 16:26:25.829501299 (98h18m22.509696869s) [upload=86448]: Starting upload
Sep 2 16:26:25.829552267 (98h18m22.509747836s) [upload=86448]: Done starting upload
Sep 2 16:26:25.829721521 (98h18m22.50991709s) [upload=86448]: Uploading segments...
Sep 2 16:26:25.829752971 (98h18m22.50994853s) [upload=86448]: Got next segment. Inline: false
Sep 2 16:26:25.829776185 (98h18m22.509971754s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Sep 2 16:26:25.829780293 (98h18m22.509975862s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Sep 2 16:26:26.144532048 (98h18m22.824727618s) [seg_pos={0 0}, upload=86448]: Begin upload segment...
Sep 2 16:26:26.144608395 (98h18m22.824803964s) [seg_pos={0 0}, upload=86448]: Done begin upload segment.
Sep 2 16:26:26.144653571 (98h18m22.82484914s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.144666315 (98h18m22.824861885s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145274800 (98h18m22.825470379s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145541139 (98h18m22.825736699s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.145782311 (98h18m22.82597788s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.146095139 (98h18m22.826290708s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147350371 (98h18m22.82754594s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147624406 (98h18m22.827819975s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.147876538 (98h18m22.828072107s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148236036 (98h18m22.828431605s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.148733107 (98h18m22.828928676s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149099258 (98h18m22.829294827s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149354847 (98h18m22.829550416s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149673897 (98h18m22.829869466s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.149930177 (98h18m22.830125746s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:26.156850710 (98h18m22.837046279s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Uploading piece...
Sep 2 16:26:27.928906223 (98h18m24.609101802s) [upload=86448]: Next returned nil segment
Sep 2 16:26:27.928931170 (98h18m24.609126729s) [upload=86448]: Waiting for error group managing segments...
Sep 2 16:26:28.222196002 (98h18m24.902391571s) [noise=true , address=45.91.116.5:4299 , piece_id=ANFPUF5ATE2CPZTMSE5LYM7UNXST7BJIVXDB5WCUXTNPPXLR53RA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.236675688 (98h18m24.916871257s) [noise=true , address=104.36.82.11:4115 , piece_id=QKMWGPD5OJMJSWESTV3RKJFBFH3KHWT2VTNZN377H2ALV2G4HOOA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.242103634 (98h18m24.922299213s) [noise=true , address=104.36.82.4:4803 , piece_id=P4F6J7A6TZR6Q5F42UTDHUVDWY6U7E36FQ4C44X5WZTYHGB3TW3A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.247401571 (98h18m24.92759714s) [noise=true , address=45.91.116.6:4973 , piece_id=UDAJIC4RZ5WXIZLWFZWDYP3TVGULQ67JCIY7BMJ33RFRQBVAZXFA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.255197658 (98h18m24.935393227s) [noise=true , address=45.91.116.9:4261 , piece_id=MRSSNHLYKX23YC6BAJ3IYAGQB2PQHW3O77QKEKM6UYNDYG3EQCCQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.261562457 (98h18m24.941758016s) [noise=true , address=77.90.31.16:4734 , piece_id=BM6SPWSKQYJYDHUNUVWXV5XCSY2Z47CCI4IM5LHTHG6Y7ONSTO5A, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.264160939 (98h18m24.944356498s) [noise=true , address=104.36.82.3:4767 , piece_id=OIPZIP7IJXDHJGHON24R3KVFEWHWOP3IVZR5HTL2RM3TVGMWRDDQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.291142165 (98h18m24.971337784s) [noise=true , address=45.91.116.7:4009 , piece_id=XT3S66VWKUCFAORRKRNM3MXB26LURVQAQHSDJCX2ESDL4OET6RAA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.300323754 (98h18m24.980519323s) [noise=true , address=45.91.116.9:4262 , piece_id=LQAUCD3MJLFAZ43TIN5XPGSZ3DQUMRD4GG2XQ4H4J3QCE3UTOLWQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.313888449 (98h18m24.994084018s) [noise=true , address=45.91.116.12:4227 , piece_id=DOQQSPC4NO6NTOKAJECZ3UAZGE5LESKHDZX4PNFERCE3CACFJAOQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.342318297 (98h18m25.022513866s) [noise=true , address=45.91.116.9:4263 , piece_id=LQO4QZAQGMF5M3UNGVT22F4GGA2MVH2H6I462JEP7K5WA7SPVMJQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.345761125 (98h18m25.025956694s) [noise=true , address=77.90.31.14:4661 , piece_id=C6PFRYZ7QK5OZ3WCRKYNVO4NXF54AZJVTQQ5A4YR3JEKJXJEVRBQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362747297 (98h18m25.042942866s) [noise=true , address=45.91.116.10:4081 , piece_id=LYIQGWWMECMDTOHT3F3ZZBRODQWR7XQ4HRPYSQTTUD3RXOIHLYWA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: <nil>
Sep 2 16:26:28.362773216 (98h18m25.042968785s) [seg_pos={0 0}, upload=86448]: Segment reached optimal threshold of 13 pieces.
Sep 2 16:26:28.362886543 (98h18m25.043082112s) [noise=true , address=104.36.82.2:4730 , piece_id=H3YGPOFQZZDOEIGHV57UY3Q43WNBOP6NKP5CJGTMX53PLEFQD4AQ, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.362938282 (98h18m25.043133851s) [noise=true , address=45.91.116.13:4153 , piece_id=M3LAVT7OQPVEWPZK6KWP2DIEF47IUH2XISTCCUFUQAKO5VTWJQRA, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363024347 (98h18m25.043219916s) [noise=true , address=45.91.116.4:4939 , piece_id=3AAVB7FPBPWCT7HXLEEVL5E6DM6JHCFDFCQ6PJHDI63SYN2QAS2Q, seg_pos={0 0}, upload=86448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX): protocol: expected piece hash; context canceled; EOF
Sep 2 16:26:28.363073882 (98h18m25.043269451s) [seg_pos={0 0}, upload=86448]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Sep 2 16:26:28.363165647 (98h18m25.043361216s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Sep 2 16:26:28.363170166 (98h18m25.043365735s) [upload=86448]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Sep 2 16:26:29.201534937 (98h18m25.881730516s) [upload=86448]: Done uploading segments...
Sep 2 16:26:29.201568251 (98h18m25.88176383s) [upload=86448]: Upload finished. err: metaclient: context canceled
Duration: 6.4334766s
core
uplink
us-select-1
|