Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.102096487s FAIL (2025-10-07 02:07:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.102126473s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.178545112s FAIL (2025-10-07 02:07:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.178581029s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.792633449s FAIL (2025-10-07 02:06:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.792669377s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.820250023s FAIL (2025-10-07 02:05:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.820278957s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.965042708s FAIL (2025-10-07 02:04:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.965070762s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.88794908s FAIL (2025-10-07 02:04:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.887978496s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.696126283s FAIL (2025-10-07 02:03:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.696148645s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.049036839s FAIL (2025-10-07 02:02:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.049070303s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.688176196s FAIL (2025-10-07 02:01:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.688203278s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.032324398s FAIL (2025-10-07 02:00:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.032358473s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.746260233s FAIL (2025-10-07 01:59:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.746291021s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.904127841s FAIL (2025-10-07 01:58:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.904186253s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.520655453s FAIL (2025-10-07 01:58:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.52068546s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.864787324s FAIL (2025-10-07 01:57:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.86482168s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.618605019s FAIL (2025-10-07 01:57:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.618632792s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.868756636s FAIL (2025-10-07 01:57:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.868793598s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.928357213s FAIL (2025-10-07 01:56:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.928392579s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.84519156s FAIL (2025-10-07 01:55:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.845221127s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.932298098s FAIL (2025-10-07 01:54:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.932316182s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.756479541s FAIL (2025-10-07 01:53:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.756511413s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.861488294s FAIL (2025-10-07 01:53:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.861518591s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.82139401s FAIL (2025-10-07 01:53:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.82142104s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.670487827s FAIL (2025-10-07 01:52:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.670550978s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.938445876s FAIL (2025-10-07 01:51:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.938483767s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.744189348s FAIL (2025-10-07 01:50:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.744223013s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.841021141s FAIL (2025-10-07 01:50:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.841057271s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.837299946s FAIL (2025-10-07 01:49:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.837327137s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.848632647s FAIL (2025-10-07 01:49:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.848690337s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.016565186s FAIL (2025-10-07 01:48:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.016596778s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.965621562s FAIL (2025-10-07 01:48:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.965656628s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.880092352s FAIL (2025-10-07 01:47:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.880128311s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.336555852s FAIL (2025-10-07 01:46:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, Piece ID: TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA) context deadline exceeded; piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA) context deadline exceeded; piecestore: (Node ID: 1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, Piece ID: 3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q) context deadline exceeded ======LOGS====== t 7 01:03:50.459807798 (323h32m35.921900281s) [upload=284743]: Starting upload Oct 7 01:03:50.459867762 (323h32m35.921960235s) [upload=284743]: Done starting upload Oct 7 01:03:50.460065419 (323h32m35.922157892s) [upload=284743]: Uploading segments... Oct 7 01:03:50.460363927 (323h32m35.92245642s) [upload=284743]: Got next segment. Inline: false Oct 7 01:03:50.460404864 (323h32m35.922497347s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 01:03:50.460410506 (323h32m35.922502979s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 01:03:50.715813017 (323h32m36.17790551s) [seg_pos={0 0}, upload=284743]: Begin upload segment... Oct 7 01:03:50.715899621 (323h32m36.177992094s) [seg_pos={0 0}, upload=284743]: Done begin upload segment. Oct 7 01:03:50.715924098 (323h32m36.178016571s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.716809483 (323h32m36.178901957s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717243621 (323h32m36.179336094s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717354882 (323h32m36.179447365s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717620609 (323h32m36.179713082s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717632671 (323h32m36.179725144s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717959705 (323h32m36.180052178s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718063302 (323h32m36.180155785s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718280355 (323h32m36.180372838s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718461950 (323h32m36.180554434s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718574995 (323h32m36.180667479s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718823789 (323h32m36.180916272s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718828328 (323h32m36.180920801s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719188033 (323h32m36.181280516s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719709937 (323h32m36.18180242s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.720907838 (323h32m36.183000321s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:52.431962504 (323h32m37.894054977s) [upload=284743]: Next returned nil segment Oct 7 01:03:52.431988694 (323h32m37.894081167s) [upload=284743]: Waiting for error group managing segments... Oct 7 01:03:52.719188280 (323h32m38.181280753s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.719818340 (323h32m38.181910823s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.720408995 (323h32m38.182501478s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.727389888 (323h32m38.189482361s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.729275599 (323h32m38.191368072s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.936259661 (323h32m38.398352144s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.987763733 (323h32m38.449856206s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.991511610 (323h32m38.453604093s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.996182033 (323h32m38.458274506s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.006584812 (323h32m38.468677295s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.059084270 (323h32m38.521176753s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.067772633 (323h32m38.529865117s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091738148 (323h32m38.553830631s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091767073 (323h32m38.553859546s) [seg_pos={0 0}, upload=284743]: Segment reached optimal threshold of 13 pieces. Oct 7 01:03:53.091898233 (323h32m38.553990716s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091909434 (323h32m38.554001917s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.091994296 (323h32m38.554086769s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091999285 (323h32m38.554091758s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092009454 (323h32m38.554101937s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection Oct 7 01:03:53.092021548 (323h32m38.554114021s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092037167 (323h32m38.55412964s) [seg_pos={0 0}, upload=284743]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 01:03:53.092099667 (323h32m38.55419214s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:03:53.092104275 (323h32m38.554196748s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:03:53.458903252 (323h32m38.920995725s) [upload=284743]: Done uploading segments... Oct 7 01:03:53.458925414 (323h32m38.921017887s) [upload=284743]: Upload finished. err: <nil> Duration: 6.336588684s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 6.014988234s FAIL (2025-10-07 01:46:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, Piece ID: TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA) context deadline exceeded; piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA) context deadline exceeded; piecestore: (Node ID: 1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, Piece ID: 3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q) context deadline exceeded ======LOGS====== t 7 01:03:50.459807798 (323h32m35.921900281s) [upload=284743]: Starting upload Oct 7 01:03:50.459867762 (323h32m35.921960235s) [upload=284743]: Done starting upload Oct 7 01:03:50.460065419 (323h32m35.922157892s) [upload=284743]: Uploading segments... Oct 7 01:03:50.460363927 (323h32m35.92245642s) [upload=284743]: Got next segment. Inline: false Oct 7 01:03:50.460404864 (323h32m35.922497347s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 01:03:50.460410506 (323h32m35.922502979s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 01:03:50.715813017 (323h32m36.17790551s) [seg_pos={0 0}, upload=284743]: Begin upload segment... Oct 7 01:03:50.715899621 (323h32m36.177992094s) [seg_pos={0 0}, upload=284743]: Done begin upload segment. Oct 7 01:03:50.715924098 (323h32m36.178016571s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.716809483 (323h32m36.178901957s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717243621 (323h32m36.179336094s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717354882 (323h32m36.179447365s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717620609 (323h32m36.179713082s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717632671 (323h32m36.179725144s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717959705 (323h32m36.180052178s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718063302 (323h32m36.180155785s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718280355 (323h32m36.180372838s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718461950 (323h32m36.180554434s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718574995 (323h32m36.180667479s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718823789 (323h32m36.180916272s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718828328 (323h32m36.180920801s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719188033 (323h32m36.181280516s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719709937 (323h32m36.18180242s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.720907838 (323h32m36.183000321s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:52.431962504 (323h32m37.894054977s) [upload=284743]: Next returned nil segment Oct 7 01:03:52.431988694 (323h32m37.894081167s) [upload=284743]: Waiting for error group managing segments... Oct 7 01:03:52.719188280 (323h32m38.181280753s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.719818340 (323h32m38.181910823s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.720408995 (323h32m38.182501478s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.727389888 (323h32m38.189482361s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.729275599 (323h32m38.191368072s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.936259661 (323h32m38.398352144s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.987763733 (323h32m38.449856206s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.991511610 (323h32m38.453604093s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.996182033 (323h32m38.458274506s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.006584812 (323h32m38.468677295s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.059084270 (323h32m38.521176753s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.067772633 (323h32m38.529865117s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091738148 (323h32m38.553830631s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091767073 (323h32m38.553859546s) [seg_pos={0 0}, upload=284743]: Segment reached optimal threshold of 13 pieces. Oct 7 01:03:53.091898233 (323h32m38.553990716s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091909434 (323h32m38.554001917s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.091994296 (323h32m38.554086769s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091999285 (323h32m38.554091758s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092009454 (323h32m38.554101937s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection Oct 7 01:03:53.092021548 (323h32m38.554114021s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092037167 (323h32m38.55412964s) [seg_pos={0 0}, upload=284743]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 01:03:53.092099667 (323h32m38.55419214s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:03:53.092104275 (323h32m38.554196748s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:03:53.458903252 (323h32m38.920995725s) [upload=284743]: Done uploading segments... Oct 7 01:03:53.458925414 (323h32m38.921017887s) [upload=284743]: Upload finished. err: <nil> Duration: 6.015022498s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.802025838s FAIL (2025-10-07 01:46:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.802057638s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [XXX.........................................................] duration: 6.047461167s FAIL (2025-10-07 01:45:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, Piece ID: TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA) context deadline exceeded; piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA) context deadline exceeded; piecestore: (Node ID: 1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, Piece ID: 3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q) context deadline exceeded ======LOGS====== t 7 01:03:50.459807798 (323h32m35.921900281s) [upload=284743]: Starting upload Oct 7 01:03:50.459867762 (323h32m35.921960235s) [upload=284743]: Done starting upload Oct 7 01:03:50.460065419 (323h32m35.922157892s) [upload=284743]: Uploading segments... Oct 7 01:03:50.460363927 (323h32m35.92245642s) [upload=284743]: Got next segment. Inline: false Oct 7 01:03:50.460404864 (323h32m35.922497347s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 01:03:50.460410506 (323h32m35.922502979s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 01:03:50.715813017 (323h32m36.17790551s) [seg_pos={0 0}, upload=284743]: Begin upload segment... Oct 7 01:03:50.715899621 (323h32m36.177992094s) [seg_pos={0 0}, upload=284743]: Done begin upload segment. Oct 7 01:03:50.715924098 (323h32m36.178016571s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.716809483 (323h32m36.178901957s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717243621 (323h32m36.179336094s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717354882 (323h32m36.179447365s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717620609 (323h32m36.179713082s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717632671 (323h32m36.179725144s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717959705 (323h32m36.180052178s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718063302 (323h32m36.180155785s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718280355 (323h32m36.180372838s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718461950 (323h32m36.180554434s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718574995 (323h32m36.180667479s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718823789 (323h32m36.180916272s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718828328 (323h32m36.180920801s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719188033 (323h32m36.181280516s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719709937 (323h32m36.18180242s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.720907838 (323h32m36.183000321s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:52.431962504 (323h32m37.894054977s) [upload=284743]: Next returned nil segment Oct 7 01:03:52.431988694 (323h32m37.894081167s) [upload=284743]: Waiting for error group managing segments... Oct 7 01:03:52.719188280 (323h32m38.181280753s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.719818340 (323h32m38.181910823s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.720408995 (323h32m38.182501478s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.727389888 (323h32m38.189482361s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.729275599 (323h32m38.191368072s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.936259661 (323h32m38.398352144s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.987763733 (323h32m38.449856206s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.991511610 (323h32m38.453604093s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.996182033 (323h32m38.458274506s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.006584812 (323h32m38.468677295s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.059084270 (323h32m38.521176753s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.067772633 (323h32m38.529865117s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091738148 (323h32m38.553830631s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091767073 (323h32m38.553859546s) [seg_pos={0 0}, upload=284743]: Segment reached optimal threshold of 13 pieces. Oct 7 01:03:53.091898233 (323h32m38.553990716s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091909434 (323h32m38.554001917s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.091994296 (323h32m38.554086769s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091999285 (323h32m38.554091758s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092009454 (323h32m38.554101937s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection Oct 7 01:03:53.092021548 (323h32m38.554114021s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092037167 (323h32m38.55412964s) [seg_pos={0 0}, upload=284743]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 01:03:53.092099667 (323h32m38.55419214s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:03:53.092104275 (323h32m38.554196748s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:03:53.458903252 (323h32m38.920995725s) [upload=284743]: Done uploading segments... Oct 7 01:03:53.458925414 (323h32m38.921017887s) [upload=284743]: Upload finished. err: <nil> Duration: 6.047497354s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.760392781s FAIL (2025-10-07 01:45:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.760433398s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.877131682s FAIL (2025-10-07 01:44:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.877154665s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 2m27.976130232s FAIL (2025-10-07 01:44:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035507969 (324h10m50.497600442s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.035989727 (324h10m50.49808221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036193044 (324h10m50.498285527s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036357518 (324h10m50.498449991s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036852841 (324h10m50.498945324s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.036952150 (324h10m50.499044633s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037194441 (324h10m50.499286924s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037396626 (324h10m50.499489099s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037557622 (324h10m50.499650105s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.037834379 (324h10m50.499926852s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038122719 (324h10m50.500215202s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038400658 (324h10m50.500493141s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.038726899 (324h10m50.500819382s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039189029 (324h10m50.501281512s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039556619 (324h10m50.501649102s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:05.039674143 (324h10m50.501766626s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Uploading piece... Oct 7 01:42:06.304412507 (324h10m51.76650498s) [upload=285290]: Next returned nil segment Oct 7 01:42:06.304437634 (324h10m51.766530117s) [upload=285290]: Waiting for error group managing segments... Oct 7 01:42:06.665137137 (324h10m52.12722962s) [noise=true , address=64.49.13.140:4510 , piece_id=QHUGLRI5S5NML2YSO54EVEP7RQTYCCHHKYSHZLM3GG3NVDIK2BSA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.842529942 (324h10m52.304622425s) [noise=true , address=193.149.164.143:4696 , piece_id=YBN5J65QYXSEWN7ISYXYYLDIS5JEOQ5G7EIR23ZPFXKW2AULFFIA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.906038754 (324h10m52.368131227s) [noise=true , address=145.79.227.33:4888 , piece_id=3K6BVX5GGS7TVSF2PFK2AVA26DRXH2PNWQBROQSF5YSCURTCQYGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.909257934 (324h10m52.371350427s) [noise=true , address=145.79.227.22:4514 , piece_id=5OEL42HHFGXWLGBIH5Y4SK7MTPVDH7EDKA3CPM46KJO4PCNW54UQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.911243114 (324h10m52.373335597s) [noise=true , address=145.79.227.40:4081 , piece_id=PTN74VINIKZWYCUGMKMC7QHW36CAAQJK6XJSQYZFG6BC3WL2XUJA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.920321261 (324h10m52.382413744s) [noise=true , address=145.79.227.23:4554 , piece_id=Q5OE722WH6DROMUHAVAZUWF6KBDUHBRDDAFY56G423MR6FNHYXUA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.945275487 (324h10m52.40736797s) [noise=true , address=77.90.31.10:4549 , piece_id=SQ2TL3NBMVZFGN4ERCO7ZMKIECJ2MDMY3YAROU2PBFHBNX5FMR5A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.966077348 (324h10m52.428169821s) [noise=true , address=45.91.116.5:4313 , piece_id=62GRA3BKVC3JMATWOWUTUR5I4WXVBB222YAHCNB24JJOSCPT3USA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.980230728 (324h10m52.442323221s) [noise=true , address=45.91.116.9:4279 , piece_id=A34QJX5EOJLQJQYF5PU3CE4S6TFP56WCIGKMD7CKFYZ2BZTW2FGQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:06.998683605 (324h10m52.460776098s) [noise=true , address=45.91.116.11:4120 , piece_id=BQG4KJ3XTCOJKNDJ6GGGYVVBPAXGSGQMFVD7CGZCY4CPVJASM2DA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.003203622 (324h10m52.465296105s) [noise=true , address=45.91.116.4:4947 , piece_id=AVANHTDO7NUTM5MA2P5Y5WQVD5B2ON3M7PX2STQQKH2VIZFKZQTQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.011848723 (324h10m52.473941206s) [noise=true , address=77.90.31.15:4731 , piece_id=DZU4QY63TGFX2JHLMIUP2WT7AUA25DX7F65UJ63XKQQGU23CQ3ZQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.034512941 (324h10m52.496605424s) [noise=true , address=77.90.31.16:4757 , piece_id=ILCIULMA6RZVXE2J5LQTIMRHLO7ICIW7WTIFXH2DUC4L4BGOFUKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041788394 (324h10m52.503880877s) [noise=true , address=77.90.31.13:4636 , piece_id=A2GDEM64YXPTT22DKFPMMS5PE2BD5JEXINBHVNS53LYBSYDG4EOQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: <nil> Oct 7 01:42:07.041876372 (324h10m52.503968875s) [seg_pos={0 0}, upload=285290]: Segment reached optimal threshold of 14 pieces. Oct 7 01:42:07.042043931 (324h10m52.504136414s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042057035 (324h10m52.504149519s) [noise=true , address=45.91.116.13:4157 , piece_id=HGQLYXVEV44C3YYJCMS2RMKNMWD4H4NC22FVH3GD4M4XUTXELSKA, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042196611 (324h10m52.504289094s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042207722 (324h10m52.504300205s) [noise=true , address=77.90.31.17:4769 , piece_id=CSYRVC3JVAJ4C3SIZWNRJZCHXRBQBJWIFD4AOQUEPFR6QHSQA43A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042253730 (324h10m52.504346213s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042275321 (324h10m52.504367794s) [noise=true , address=77.90.31.18:4837 , piece_id=OC6HN4TIK3DT3KF4Q5O4SCRVPI3UZ3GOEI7WBR734QE5T3U3KS6A, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042317130 (324h10m52.504409623s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP): protocol: expected piece hash; context canceled; EOF Oct 7 01:42:07.042326639 (324h10m52.504419132s) [noise=true , address=77.90.31.21:4885 , piece_id=PDFIHJNDEJJAWMN4XFHSFASUBFRCTF67R6XD6DIAX25YHCRQ25DQ, seg_pos={0 0}, upload=285290]: Long tail cancellation due to optimal threshold Oct 7 01:42:07.042349251 (324h10m52.504441735s) [seg_pos={0 0}, upload=285290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 7 01:42:07.042455133 (324h10m52.504547616s) [upload=285290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:42:07.042462588 (324h10m52.504555071s) [upload=285290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:44:32.065419122 (324h13m17.527511605s) [upload=285290]: Done uploading segments... Oct 7 01:44:32.065448999 (324h13m17.527541492s) [upload=285290]: Upload finished. err: metaclient: context deadline exceeded Duration: 2m27.976160331s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.XXX........................................................] duration: 6.271441194s FAIL (2025-10-07 01:44:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, Piece ID: TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA) context deadline exceeded; piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA) context deadline exceeded; piecestore: (Node ID: 1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, Piece ID: 3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q) context deadline exceeded ======LOGS====== t 7 01:03:50.459807798 (323h32m35.921900281s) [upload=284743]: Starting upload Oct 7 01:03:50.459867762 (323h32m35.921960235s) [upload=284743]: Done starting upload Oct 7 01:03:50.460065419 (323h32m35.922157892s) [upload=284743]: Uploading segments... Oct 7 01:03:50.460363927 (323h32m35.92245642s) [upload=284743]: Got next segment. Inline: false Oct 7 01:03:50.460404864 (323h32m35.922497347s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 01:03:50.460410506 (323h32m35.922502979s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 01:03:50.715813017 (323h32m36.17790551s) [seg_pos={0 0}, upload=284743]: Begin upload segment... Oct 7 01:03:50.715899621 (323h32m36.177992094s) [seg_pos={0 0}, upload=284743]: Done begin upload segment. Oct 7 01:03:50.715924098 (323h32m36.178016571s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.716809483 (323h32m36.178901957s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717243621 (323h32m36.179336094s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717354882 (323h32m36.179447365s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717620609 (323h32m36.179713082s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717632671 (323h32m36.179725144s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717959705 (323h32m36.180052178s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718063302 (323h32m36.180155785s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718280355 (323h32m36.180372838s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718461950 (323h32m36.180554434s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718574995 (323h32m36.180667479s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718823789 (323h32m36.180916272s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718828328 (323h32m36.180920801s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719188033 (323h32m36.181280516s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719709937 (323h32m36.18180242s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.720907838 (323h32m36.183000321s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:52.431962504 (323h32m37.894054977s) [upload=284743]: Next returned nil segment Oct 7 01:03:52.431988694 (323h32m37.894081167s) [upload=284743]: Waiting for error group managing segments... Oct 7 01:03:52.719188280 (323h32m38.181280753s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.719818340 (323h32m38.181910823s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.720408995 (323h32m38.182501478s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.727389888 (323h32m38.189482361s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.729275599 (323h32m38.191368072s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.936259661 (323h32m38.398352144s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.987763733 (323h32m38.449856206s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.991511610 (323h32m38.453604093s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.996182033 (323h32m38.458274506s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.006584812 (323h32m38.468677295s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.059084270 (323h32m38.521176753s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.067772633 (323h32m38.529865117s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091738148 (323h32m38.553830631s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091767073 (323h32m38.553859546s) [seg_pos={0 0}, upload=284743]: Segment reached optimal threshold of 13 pieces. Oct 7 01:03:53.091898233 (323h32m38.553990716s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091909434 (323h32m38.554001917s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.091994296 (323h32m38.554086769s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091999285 (323h32m38.554091758s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092009454 (323h32m38.554101937s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection Oct 7 01:03:53.092021548 (323h32m38.554114021s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092037167 (323h32m38.55412964s) [seg_pos={0 0}, upload=284743]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 01:03:53.092099667 (323h32m38.55419214s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:03:53.092104275 (323h32m38.554196748s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:03:53.458903252 (323h32m38.920995725s) [upload=284743]: Done uploading segments... Oct 7 01:03:53.458925414 (323h32m38.921017887s) [upload=284743]: Upload finished. err: <nil> Duration: 6.271487009s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.XXX.......................................................] duration: 6.055062536s FAIL (2025-10-07 01:43:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, Piece ID: TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA) context deadline exceeded; piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA) context deadline exceeded; piecestore: (Node ID: 1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, Piece ID: 3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q) context deadline exceeded ======LOGS====== t 7 01:03:50.459807798 (323h32m35.921900281s) [upload=284743]: Starting upload Oct 7 01:03:50.459867762 (323h32m35.921960235s) [upload=284743]: Done starting upload Oct 7 01:03:50.460065419 (323h32m35.922157892s) [upload=284743]: Uploading segments... Oct 7 01:03:50.460363927 (323h32m35.92245642s) [upload=284743]: Got next segment. Inline: false Oct 7 01:03:50.460404864 (323h32m35.922497347s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 01:03:50.460410506 (323h32m35.922502979s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 01:03:50.715813017 (323h32m36.17790551s) [seg_pos={0 0}, upload=284743]: Begin upload segment... Oct 7 01:03:50.715899621 (323h32m36.177992094s) [seg_pos={0 0}, upload=284743]: Done begin upload segment. Oct 7 01:03:50.715924098 (323h32m36.178016571s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.716809483 (323h32m36.178901957s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717243621 (323h32m36.179336094s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717354882 (323h32m36.179447365s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717620609 (323h32m36.179713082s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717632671 (323h32m36.179725144s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717959705 (323h32m36.180052178s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718063302 (323h32m36.180155785s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718280355 (323h32m36.180372838s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718461950 (323h32m36.180554434s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718574995 (323h32m36.180667479s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718823789 (323h32m36.180916272s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718828328 (323h32m36.180920801s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719188033 (323h32m36.181280516s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719709937 (323h32m36.18180242s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.720907838 (323h32m36.183000321s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:52.431962504 (323h32m37.894054977s) [upload=284743]: Next returned nil segment Oct 7 01:03:52.431988694 (323h32m37.894081167s) [upload=284743]: Waiting for error group managing segments... Oct 7 01:03:52.719188280 (323h32m38.181280753s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.719818340 (323h32m38.181910823s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.720408995 (323h32m38.182501478s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.727389888 (323h32m38.189482361s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.729275599 (323h32m38.191368072s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.936259661 (323h32m38.398352144s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.987763733 (323h32m38.449856206s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.991511610 (323h32m38.453604093s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.996182033 (323h32m38.458274506s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.006584812 (323h32m38.468677295s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.059084270 (323h32m38.521176753s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.067772633 (323h32m38.529865117s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091738148 (323h32m38.553830631s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091767073 (323h32m38.553859546s) [seg_pos={0 0}, upload=284743]: Segment reached optimal threshold of 13 pieces. Oct 7 01:03:53.091898233 (323h32m38.553990716s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091909434 (323h32m38.554001917s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.091994296 (323h32m38.554086769s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091999285 (323h32m38.554091758s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092009454 (323h32m38.554101937s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection Oct 7 01:03:53.092021548 (323h32m38.554114021s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092037167 (323h32m38.55412964s) [seg_pos={0 0}, upload=284743]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 01:03:53.092099667 (323h32m38.55419214s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:03:53.092104275 (323h32m38.554196748s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:03:53.458903252 (323h32m38.920995725s) [upload=284743]: Done uploading segments... Oct 7 01:03:53.458925414 (323h32m38.921017887s) [upload=284743]: Upload finished. err: <nil> Duration: 6.055095219s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.XXX......................................................] duration: 6.031396306s FAIL (2025-10-07 01:43:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, Piece ID: TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA) context deadline exceeded; piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA) context deadline exceeded; piecestore: (Node ID: 1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, Piece ID: 3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q) context deadline exceeded ======LOGS====== t 7 01:03:50.459807798 (323h32m35.921900281s) [upload=284743]: Starting upload Oct 7 01:03:50.459867762 (323h32m35.921960235s) [upload=284743]: Done starting upload Oct 7 01:03:50.460065419 (323h32m35.922157892s) [upload=284743]: Uploading segments... Oct 7 01:03:50.460363927 (323h32m35.92245642s) [upload=284743]: Got next segment. Inline: false Oct 7 01:03:50.460404864 (323h32m35.922497347s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 01:03:50.460410506 (323h32m35.922502979s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 01:03:50.715813017 (323h32m36.17790551s) [seg_pos={0 0}, upload=284743]: Begin upload segment... Oct 7 01:03:50.715899621 (323h32m36.177992094s) [seg_pos={0 0}, upload=284743]: Done begin upload segment. Oct 7 01:03:50.715924098 (323h32m36.178016571s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.716809483 (323h32m36.178901957s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717243621 (323h32m36.179336094s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717354882 (323h32m36.179447365s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717620609 (323h32m36.179713082s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717632671 (323h32m36.179725144s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717959705 (323h32m36.180052178s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718063302 (323h32m36.180155785s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718280355 (323h32m36.180372838s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718461950 (323h32m36.180554434s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718574995 (323h32m36.180667479s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718823789 (323h32m36.180916272s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718828328 (323h32m36.180920801s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719188033 (323h32m36.181280516s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719709937 (323h32m36.18180242s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.720907838 (323h32m36.183000321s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:52.431962504 (323h32m37.894054977s) [upload=284743]: Next returned nil segment Oct 7 01:03:52.431988694 (323h32m37.894081167s) [upload=284743]: Waiting for error group managing segments... Oct 7 01:03:52.719188280 (323h32m38.181280753s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.719818340 (323h32m38.181910823s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.720408995 (323h32m38.182501478s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.727389888 (323h32m38.189482361s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.729275599 (323h32m38.191368072s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.936259661 (323h32m38.398352144s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.987763733 (323h32m38.449856206s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.991511610 (323h32m38.453604093s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.996182033 (323h32m38.458274506s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.006584812 (323h32m38.468677295s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.059084270 (323h32m38.521176753s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.067772633 (323h32m38.529865117s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091738148 (323h32m38.553830631s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091767073 (323h32m38.553859546s) [seg_pos={0 0}, upload=284743]: Segment reached optimal threshold of 13 pieces. Oct 7 01:03:53.091898233 (323h32m38.553990716s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091909434 (323h32m38.554001917s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.091994296 (323h32m38.554086769s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091999285 (323h32m38.554091758s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092009454 (323h32m38.554101937s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection Oct 7 01:03:53.092021548 (323h32m38.554114021s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092037167 (323h32m38.55412964s) [seg_pos={0 0}, upload=284743]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 01:03:53.092099667 (323h32m38.55419214s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:03:53.092104275 (323h32m38.554196748s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:03:53.458903252 (323h32m38.920995725s) [upload=284743]: Done uploading segments... Oct 7 01:03:53.458925414 (323h32m38.921017887s) [upload=284743]: Upload finished. err: <nil> Duration: 6.031460419s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.908638107s FAIL (2025-10-07 01:42:41 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 5.908669668s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.XXX.....................................................] duration: 5.988019583s FAIL (2025-10-07 01:42:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, Piece ID: TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA) context deadline exceeded; piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA) context deadline exceeded; piecestore: (Node ID: 1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, Piece ID: 3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q) context deadline exceeded ======LOGS====== t 7 01:03:50.459807798 (323h32m35.921900281s) [upload=284743]: Starting upload Oct 7 01:03:50.459867762 (323h32m35.921960235s) [upload=284743]: Done starting upload Oct 7 01:03:50.460065419 (323h32m35.922157892s) [upload=284743]: Uploading segments... Oct 7 01:03:50.460363927 (323h32m35.92245642s) [upload=284743]: Got next segment. Inline: false Oct 7 01:03:50.460404864 (323h32m35.922497347s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 01:03:50.460410506 (323h32m35.922502979s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 01:03:50.715813017 (323h32m36.17790551s) [seg_pos={0 0}, upload=284743]: Begin upload segment... Oct 7 01:03:50.715899621 (323h32m36.177992094s) [seg_pos={0 0}, upload=284743]: Done begin upload segment. Oct 7 01:03:50.715924098 (323h32m36.178016571s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.716809483 (323h32m36.178901957s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717243621 (323h32m36.179336094s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717354882 (323h32m36.179447365s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717620609 (323h32m36.179713082s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717632671 (323h32m36.179725144s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717959705 (323h32m36.180052178s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718063302 (323h32m36.180155785s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718280355 (323h32m36.180372838s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718461950 (323h32m36.180554434s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718574995 (323h32m36.180667479s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718823789 (323h32m36.180916272s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718828328 (323h32m36.180920801s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719188033 (323h32m36.181280516s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719709937 (323h32m36.18180242s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.720907838 (323h32m36.183000321s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:52.431962504 (323h32m37.894054977s) [upload=284743]: Next returned nil segment Oct 7 01:03:52.431988694 (323h32m37.894081167s) [upload=284743]: Waiting for error group managing segments... Oct 7 01:03:52.719188280 (323h32m38.181280753s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.719818340 (323h32m38.181910823s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.720408995 (323h32m38.182501478s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.727389888 (323h32m38.189482361s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.729275599 (323h32m38.191368072s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.936259661 (323h32m38.398352144s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.987763733 (323h32m38.449856206s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.991511610 (323h32m38.453604093s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.996182033 (323h32m38.458274506s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.006584812 (323h32m38.468677295s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.059084270 (323h32m38.521176753s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.067772633 (323h32m38.529865117s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091738148 (323h32m38.553830631s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091767073 (323h32m38.553859546s) [seg_pos={0 0}, upload=284743]: Segment reached optimal threshold of 13 pieces. Oct 7 01:03:53.091898233 (323h32m38.553990716s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091909434 (323h32m38.554001917s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.091994296 (323h32m38.554086769s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091999285 (323h32m38.554091758s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092009454 (323h32m38.554101937s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection Oct 7 01:03:53.092021548 (323h32m38.554114021s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092037167 (323h32m38.55412964s) [seg_pos={0 0}, upload=284743]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 01:03:53.092099667 (323h32m38.55419214s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:03:53.092104275 (323h32m38.554196748s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:03:53.458903252 (323h32m38.920995725s) [upload=284743]: Done uploading segments... Oct 7 01:03:53.458925414 (323h32m38.921017887s) [upload=284743]: Upload finished. err: <nil> Duration: 5.988052705s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.186520581s FAIL (2025-10-07 01:41:42 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 6.186553845s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [X..X.XXX....................................................] duration: 5.995873738s FAIL (2025-10-07 01:41:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, Piece ID: TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA) context deadline exceeded; piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA) context deadline exceeded; piecestore: (Node ID: 1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, Piece ID: 3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q) context deadline exceeded ======LOGS====== t 7 01:03:50.459807798 (323h32m35.921900281s) [upload=284743]: Starting upload Oct 7 01:03:50.459867762 (323h32m35.921960235s) [upload=284743]: Done starting upload Oct 7 01:03:50.460065419 (323h32m35.922157892s) [upload=284743]: Uploading segments... Oct 7 01:03:50.460363927 (323h32m35.92245642s) [upload=284743]: Got next segment. Inline: false Oct 7 01:03:50.460404864 (323h32m35.922497347s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 01:03:50.460410506 (323h32m35.922502979s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 01:03:50.715813017 (323h32m36.17790551s) [seg_pos={0 0}, upload=284743]: Begin upload segment... Oct 7 01:03:50.715899621 (323h32m36.177992094s) [seg_pos={0 0}, upload=284743]: Done begin upload segment. Oct 7 01:03:50.715924098 (323h32m36.178016571s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.716809483 (323h32m36.178901957s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717243621 (323h32m36.179336094s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717354882 (323h32m36.179447365s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717620609 (323h32m36.179713082s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717632671 (323h32m36.179725144s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717959705 (323h32m36.180052178s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718063302 (323h32m36.180155785s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718280355 (323h32m36.180372838s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718461950 (323h32m36.180554434s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718574995 (323h32m36.180667479s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718823789 (323h32m36.180916272s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718828328 (323h32m36.180920801s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719188033 (323h32m36.181280516s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719709937 (323h32m36.18180242s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.720907838 (323h32m36.183000321s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:52.431962504 (323h32m37.894054977s) [upload=284743]: Next returned nil segment Oct 7 01:03:52.431988694 (323h32m37.894081167s) [upload=284743]: Waiting for error group managing segments... Oct 7 01:03:52.719188280 (323h32m38.181280753s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.719818340 (323h32m38.181910823s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.720408995 (323h32m38.182501478s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.727389888 (323h32m38.189482361s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.729275599 (323h32m38.191368072s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.936259661 (323h32m38.398352144s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.987763733 (323h32m38.449856206s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.991511610 (323h32m38.453604093s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.996182033 (323h32m38.458274506s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.006584812 (323h32m38.468677295s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.059084270 (323h32m38.521176753s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.067772633 (323h32m38.529865117s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091738148 (323h32m38.553830631s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091767073 (323h32m38.553859546s) [seg_pos={0 0}, upload=284743]: Segment reached optimal threshold of 13 pieces. Oct 7 01:03:53.091898233 (323h32m38.553990716s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091909434 (323h32m38.554001917s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.091994296 (323h32m38.554086769s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091999285 (323h32m38.554091758s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092009454 (323h32m38.554101937s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection Oct 7 01:03:53.092021548 (323h32m38.554114021s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092037167 (323h32m38.55412964s) [seg_pos={0 0}, upload=284743]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 01:03:53.092099667 (323h32m38.55419214s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:03:53.092104275 (323h32m38.554196748s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:03:53.458903252 (323h32m38.920995725s) [upload=284743]: Done uploading segments... Oct 7 01:03:53.458925414 (323h32m38.921017887s) [upload=284743]: Upload finished. err: <nil> Duration: 5.995904397s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X..X.XXX...................................................] duration: 5.967947482s FAIL (2025-10-07 01:40:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, Piece ID: TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA) context deadline exceeded; piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA) context deadline exceeded; piecestore: (Node ID: 1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, Piece ID: 3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q) context deadline exceeded ======LOGS====== t 7 01:03:50.459807798 (323h32m35.921900281s) [upload=284743]: Starting upload Oct 7 01:03:50.459867762 (323h32m35.921960235s) [upload=284743]: Done starting upload Oct 7 01:03:50.460065419 (323h32m35.922157892s) [upload=284743]: Uploading segments... Oct 7 01:03:50.460363927 (323h32m35.92245642s) [upload=284743]: Got next segment. Inline: false Oct 7 01:03:50.460404864 (323h32m35.922497347s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 01:03:50.460410506 (323h32m35.922502979s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 01:03:50.715813017 (323h32m36.17790551s) [seg_pos={0 0}, upload=284743]: Begin upload segment... Oct 7 01:03:50.715899621 (323h32m36.177992094s) [seg_pos={0 0}, upload=284743]: Done begin upload segment. Oct 7 01:03:50.715924098 (323h32m36.178016571s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.716809483 (323h32m36.178901957s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717243621 (323h32m36.179336094s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717354882 (323h32m36.179447365s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717620609 (323h32m36.179713082s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717632671 (323h32m36.179725144s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717959705 (323h32m36.180052178s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718063302 (323h32m36.180155785s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718280355 (323h32m36.180372838s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718461950 (323h32m36.180554434s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718574995 (323h32m36.180667479s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718823789 (323h32m36.180916272s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718828328 (323h32m36.180920801s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719188033 (323h32m36.181280516s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719709937 (323h32m36.18180242s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.720907838 (323h32m36.183000321s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:52.431962504 (323h32m37.894054977s) [upload=284743]: Next returned nil segment Oct 7 01:03:52.431988694 (323h32m37.894081167s) [upload=284743]: Waiting for error group managing segments... Oct 7 01:03:52.719188280 (323h32m38.181280753s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.719818340 (323h32m38.181910823s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.720408995 (323h32m38.182501478s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.727389888 (323h32m38.189482361s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.729275599 (323h32m38.191368072s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.936259661 (323h32m38.398352144s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.987763733 (323h32m38.449856206s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.991511610 (323h32m38.453604093s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.996182033 (323h32m38.458274506s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.006584812 (323h32m38.468677295s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.059084270 (323h32m38.521176753s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.067772633 (323h32m38.529865117s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091738148 (323h32m38.553830631s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091767073 (323h32m38.553859546s) [seg_pos={0 0}, upload=284743]: Segment reached optimal threshold of 13 pieces. Oct 7 01:03:53.091898233 (323h32m38.553990716s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091909434 (323h32m38.554001917s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.091994296 (323h32m38.554086769s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091999285 (323h32m38.554091758s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092009454 (323h32m38.554101937s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection Oct 7 01:03:53.092021548 (323h32m38.554114021s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092037167 (323h32m38.55412964s) [seg_pos={0 0}, upload=284743]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 01:03:53.092099667 (323h32m38.55419214s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:03:53.092104275 (323h32m38.554196748s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:03:53.458903252 (323h32m38.920995725s) [upload=284743]: Done uploading segments... Oct 7 01:03:53.458925414 (323h32m38.921017887s) [upload=284743]: Upload finished. err: <nil> Duration: 5.967983199s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.080598929s FAIL (2025-10-07 01:40:57 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 6.08063032s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.18973491s FAIL (2025-10-07 01:40:39 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 6.189756521s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X..X.XXX..................................................] duration: 6.015258789s FAIL (2025-10-07 01:40:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, Piece ID: TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA) context deadline exceeded; piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA) context deadline exceeded; piecestore: (Node ID: 1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, Piece ID: 3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q) context deadline exceeded ======LOGS====== t 7 01:03:50.459807798 (323h32m35.921900281s) [upload=284743]: Starting upload Oct 7 01:03:50.459867762 (323h32m35.921960235s) [upload=284743]: Done starting upload Oct 7 01:03:50.460065419 (323h32m35.922157892s) [upload=284743]: Uploading segments... Oct 7 01:03:50.460363927 (323h32m35.92245642s) [upload=284743]: Got next segment. Inline: false Oct 7 01:03:50.460404864 (323h32m35.922497347s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 01:03:50.460410506 (323h32m35.922502979s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 01:03:50.715813017 (323h32m36.17790551s) [seg_pos={0 0}, upload=284743]: Begin upload segment... Oct 7 01:03:50.715899621 (323h32m36.177992094s) [seg_pos={0 0}, upload=284743]: Done begin upload segment. Oct 7 01:03:50.715924098 (323h32m36.178016571s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.716809483 (323h32m36.178901957s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717243621 (323h32m36.179336094s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717354882 (323h32m36.179447365s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717620609 (323h32m36.179713082s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717632671 (323h32m36.179725144s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717959705 (323h32m36.180052178s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718063302 (323h32m36.180155785s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718280355 (323h32m36.180372838s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718461950 (323h32m36.180554434s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718574995 (323h32m36.180667479s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718823789 (323h32m36.180916272s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718828328 (323h32m36.180920801s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719188033 (323h32m36.181280516s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719709937 (323h32m36.18180242s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.720907838 (323h32m36.183000321s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:52.431962504 (323h32m37.894054977s) [upload=284743]: Next returned nil segment Oct 7 01:03:52.431988694 (323h32m37.894081167s) [upload=284743]: Waiting for error group managing segments... Oct 7 01:03:52.719188280 (323h32m38.181280753s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.719818340 (323h32m38.181910823s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.720408995 (323h32m38.182501478s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.727389888 (323h32m38.189482361s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.729275599 (323h32m38.191368072s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.936259661 (323h32m38.398352144s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.987763733 (323h32m38.449856206s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.991511610 (323h32m38.453604093s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.996182033 (323h32m38.458274506s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.006584812 (323h32m38.468677295s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.059084270 (323h32m38.521176753s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.067772633 (323h32m38.529865117s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091738148 (323h32m38.553830631s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091767073 (323h32m38.553859546s) [seg_pos={0 0}, upload=284743]: Segment reached optimal threshold of 13 pieces. Oct 7 01:03:53.091898233 (323h32m38.553990716s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091909434 (323h32m38.554001917s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.091994296 (323h32m38.554086769s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091999285 (323h32m38.554091758s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092009454 (323h32m38.554101937s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection Oct 7 01:03:53.092021548 (323h32m38.554114021s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092037167 (323h32m38.55412964s) [seg_pos={0 0}, upload=284743]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 01:03:53.092099667 (323h32m38.55419214s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:03:53.092104275 (323h32m38.554196748s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:03:53.458903252 (323h32m38.920995725s) [upload=284743]: Done uploading segments... Oct 7 01:03:53.458925414 (323h32m38.921017887s) [upload=284743]: Upload finished. err: <nil> Duration: 6.015295628s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X..X.XXX.................................................] duration: 5.885134312s FAIL (2025-10-07 01:39:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, Piece ID: TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA) context deadline exceeded; piecestore: (Node ID: 12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, Piece ID: N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA) context deadline exceeded; piecestore: (Node ID: 1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, Piece ID: 3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q) context deadline exceeded ======LOGS====== t 7 01:03:50.459807798 (323h32m35.921900281s) [upload=284743]: Starting upload Oct 7 01:03:50.459867762 (323h32m35.921960235s) [upload=284743]: Done starting upload Oct 7 01:03:50.460065419 (323h32m35.922157892s) [upload=284743]: Uploading segments... Oct 7 01:03:50.460363927 (323h32m35.92245642s) [upload=284743]: Got next segment. Inline: false Oct 7 01:03:50.460404864 (323h32m35.922497347s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 7 01:03:50.460410506 (323h32m35.922502979s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 7 01:03:50.715813017 (323h32m36.17790551s) [seg_pos={0 0}, upload=284743]: Begin upload segment... Oct 7 01:03:50.715899621 (323h32m36.177992094s) [seg_pos={0 0}, upload=284743]: Done begin upload segment. Oct 7 01:03:50.715924098 (323h32m36.178016571s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.716809483 (323h32m36.178901957s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717243621 (323h32m36.179336094s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717354882 (323h32m36.179447365s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717620609 (323h32m36.179713082s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717632671 (323h32m36.179725144s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.717959705 (323h32m36.180052178s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718063302 (323h32m36.180155785s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718280355 (323h32m36.180372838s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718461950 (323h32m36.180554434s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718574995 (323h32m36.180667479s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718823789 (323h32m36.180916272s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.718828328 (323h32m36.180920801s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719188033 (323h32m36.181280516s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.719709937 (323h32m36.18180242s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:50.720907838 (323h32m36.183000321s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Uploading piece... Oct 7 01:03:52.431962504 (323h32m37.894054977s) [upload=284743]: Next returned nil segment Oct 7 01:03:52.431988694 (323h32m37.894081167s) [upload=284743]: Waiting for error group managing segments... Oct 7 01:03:52.719188280 (323h32m38.181280753s) [noise=true , address=145.79.227.2:4114 , piece_id=ARFXWCGWCWSRVDYBZKI63TP2DIOA32T4VQ52XVEEO7GCA5777OAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.719818340 (323h32m38.181910823s) [noise=true , address=145.79.227.16:4910 , piece_id=SRA6ZX7QUQAXDSP6WYM6SGSXSITYIHMHMLFTIPCQEXWFVRLRQWCQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.720408995 (323h32m38.182501478s) [noise=true , address=145.79.227.13:4804 , piece_id=RKEXEBQOV27CJUN2IRI3A2JMFC3AQJME6FIYMEYGWPKGKMJEOMJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.727389888 (323h32m38.189482361s) [noise=true , address=145.79.227.2:4113 , piece_id=32ST7UU6NNWBQGMFOUWVLUL44T436GY4RZRQPQCHQP35WVNWNMWQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.729275599 (323h32m38.191368072s) [noise=true , address=145.79.227.4:4187 , piece_id=O2BLXFNRNNEGN3I4P3NJZF365MBVKF2N32G35QLMYO3UIB53FHOQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.936259661 (323h32m38.398352144s) [noise=true , address=45.91.116.6:4973 , piece_id=2SDCBRJRLQPZWVDP5MXFVJ6C2WKX3HRRQ5QVUFY2FVMIJMLK3U3Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.987763733 (323h32m38.449856206s) [noise=true , address=77.90.31.15:4697 , piece_id=2U7GVBUKGXDAHV2QMQR5BTF7JDS5URTGZI2WVNACP6SQM6DWXWAA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.991511610 (323h32m38.453604093s) [noise=true , address=45.91.116.4:4938 , piece_id=DOGSDCSN2IKFISSZJ7VJQUZCASUYWUWHINLVBHO3HM5TXT4MLLHQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:52.996182033 (323h32m38.458274506s) [noise=true , address=45.91.116.12:4225 , piece_id=TERMFVWD5J6NBB6GTQWEPQAFP4WOJ6CZKV7BX633DQHSJIHEBDKA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.006584812 (323h32m38.468677295s) [noise=true , address=77.90.31.13:4626 , piece_id=7KVEAF7N57KNIUAV5OK3XGBXANPMY3VO3VUNVQ2HJOOMTZANVUJA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.059084270 (323h32m38.521176753s) [noise=true , address=77.90.31.17:4771 , piece_id=ZGDQH7ADAYHD4JVDFNCEO4DCD6JUGK6IPIJAHRNVSMESYGKYHNLA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.067772633 (323h32m38.529865117s) [noise=true , address=45.91.116.5:4299 , piece_id=N5C4XJ5HVMJRKECKCJPVTYSQXQP3KLRHMNYIAGC2M2CG6N25G5XA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091738148 (323h32m38.553830631s) [noise=true , address=45.91.116.14:4190 , piece_id=3IIOMD2FG6WQQ4SGF6RAAISUW4I4XPOLCZUTLPOXB6BNMYKIS26Q, seg_pos={0 0}, upload=284743]: Done uploading piece. err: <nil> Oct 7 01:03:53.091767073 (323h32m38.553859546s) [seg_pos={0 0}, upload=284743]: Segment reached optimal threshold of 13 pieces. Oct 7 01:03:53.091898233 (323h32m38.553990716s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091909434 (323h32m38.554001917s) [noise=true , address=45.91.116.6:4974 , piece_id=M4JHTDMJB5SM2XZPBOS3NPTJ3RJFNPBP344LZA3FT4S4JF3AAA7A, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.091994296 (323h32m38.554086769s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF): protocol: expected piece hash; context canceled; EOF Oct 7 01:03:53.091999285 (323h32m38.554091758s) [noise=true , address=45.91.116.9:4263 , piece_id=4F5ZH6FHPBPTDFKH5YMYVDCOXDDQSYQGN4E65XNZ6GZIWTT6H5GQ, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092009454 (323h32m38.554101937s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48488->45.91.116.7:4009: use of closed network connection Oct 7 01:03:53.092021548 (323h32m38.554114021s) [noise=true , address=45.91.116.7:4009 , piece_id=3SIGONZVXA3AQKHQAQLJORCLN3REBC6EBJOEAPYMFJ3G7E22PEDA, seg_pos={0 0}, upload=284743]: Long tail cancellation due to optimal threshold Oct 7 01:03:53.092037167 (323h32m38.55412964s) [seg_pos={0 0}, upload=284743]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 7 01:03:53.092099667 (323h32m38.55419214s) [upload=284743]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 7 01:03:53.092104275 (323h32m38.554196748s) [upload=284743]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 7 01:03:53.458903252 (323h32m38.920995725s) [upload=284743]: Done uploading segments... Oct 7 01:03:53.458925414 (323h32m38.921017887s) [upload=284743]: Upload finished. err: <nil> Duration: 5.885167986s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)