Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
9.023215388s
FAIL (2025-10-08 11:29:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 9.023248932s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
6.217608792s
FAIL (2025-10-08 11:29:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 6.217644309s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
6.617667482s
FAIL (2025-10-08 11:28:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 6.617709804s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
20.657713115s
FAIL (2025-10-08 11:28:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 20.657737832s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
8.258314482s
FAIL (2025-10-08 11:27:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 8.258343219s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
6.718652154s
FAIL (2025-10-08 11:26:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 6.71872383s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
7.827287385s
FAIL (2025-10-08 11:25:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 7.827318162s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
8.939469177s
FAIL (2025-10-08 11:24:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 8.939501458s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
12.344279148s
FAIL (2025-10-08 11:23:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 12.344312019s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
18.409575661s
FAIL (2025-10-08 11:23:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 18.409609785s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
26.566326677s
FAIL (2025-10-08 11:22:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 26.566367484s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
12.42521166s
FAIL (2025-10-08 11:21:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 12.425232791s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.002047017s
FAIL (2025-10-08 11:21:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 8 11:20:51.556266963 (357h49m37.018359436s) [upload=314829]: Starting upload
Oct 8 11:20:51.556342678 (357h49m37.018435151s) [upload=314829]: Done starting upload
Oct 8 11:20:51.556564100 (357h49m37.018656583s) [upload=314829]: Uploading segments...
Oct 8 11:20:51.556709316 (357h49m37.018801819s) [upload=314829]: Got next segment. Inline: false
Oct 8 11:20:51.556754933 (357h49m37.018847416s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 8 11:20:51.556760925 (357h49m37.018853408s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 8 11:20:51.879100843 (357h49m37.341193336s) [seg_pos={0 0}, upload=314829]: Begin upload segment...
Oct 8 11:20:51.879187378 (357h49m37.341279861s) [seg_pos={0 0}, upload=314829]: Done begin upload segment.
Oct 8 11:20:51.879235429 (357h49m37.341327912s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.879289012 (357h49m37.341381485s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880000436 (357h49m37.342092919s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880450884 (357h49m37.342543367s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.880751376 (357h49m37.342843849s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881134245 (357h49m37.343226718s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.881505361 (357h49m37.343597834s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.882612450 (357h49m37.344704923s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883160644 (357h49m37.345253127s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.883704279 (357h49m37.345796762s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.884376269 (357h49m37.346468742s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885073095 (357h49m37.347165569s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885123391 (357h49m37.347215874s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.885666505 (357h49m37.347758988s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886019117 (357h49m37.34811159s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:51.886407987 (357h49m37.34850046s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Uploading piece...
Oct 8 11:20:53.482004528 (357h49m38.944097001s) [upload=314829]: Next returned nil segment
Oct 8 11:20:53.482025709 (357h49m38.944118182s) [upload=314829]: Waiting for error group managing segments...
Oct 8 11:20:53.861704021 (357h49m39.323796504s) [noise=true , address=145.79.227.5:4222 , piece_id=MYQGWRU26NLS55GV3QXFO5RRXZ6NE53KNWOGXCPTUTTV54FDSGXQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.861949618 (357h49m39.324042091s) [noise=true , address=145.79.227.4:4186 , piece_id=F3LXRJUQIYDQLHQXMK7GE4OOKZBZL7XHZQDM35JAIVIVXB3MA5WA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.867494648 (357h49m39.329587131s) [noise=true , address=145.79.227.7:4294 , piece_id=ROIFSQTDLJNR2GLQJKAY5YDBMPEZPSQ66DJWKH2OFTQE2AVWLTTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869052353 (357h49m39.331144836s) [noise=true , address=145.79.227.13:4804 , piece_id=P5XDVTWWR4H7U66OYGFHA54AEI7KMY3R6UTMNVDGOGI2GDRIRP3Q, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.869833992 (357h49m39.331926465s) [noise=true , address=145.79.227.14:4839 , piece_id=4FGPQXT5WKVR4JR6BBCBY336ZUR2NQLUH5HPVCYFHPH3GMMTYAFQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.870903568 (357h49m39.332996041s) [noise=true , address=145.79.227.16:4911 , piece_id=BIVMQKGM7KMB5GPQWFQ6QSZ345NIOIEE47347LNJNT2EFCNDABIQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.878910505 (357h49m39.341002988s) [noise=true , address=145.79.227.19:4078 , piece_id=7SVDYGUR5IV6XPWB56FJ553LXROO5WXH75FKH5Q2NJIPTQVV4S7A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:53.882763001 (357h49m39.344855494s) [noise=true , address=145.79.227.7:4295 , piece_id=GZGIBTJYG4Z6YQ3NM4W4X6XPSIFWNY2BQOQGB4B5D6EGBBX6MHTQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.153361885 (357h49m39.615454368s) [noise=true , address=77.90.31.14:4662 , piece_id=B7TRR7ZWHRN6WQHDOHELIXDWJMGFXLSJVPKY6FOTO2BF7KX3RVRA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.157214742 (357h49m39.619307225s) [noise=true , address=77.90.31.17:4770 , piece_id=4Q6T2VTPTOFV7WNDDOJV5S3FFZ2YULO2MOQIBZYJMUZP7BMIUDPA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.171725844 (357h49m39.633818327s) [noise=true , address=45.91.116.11:4119 , piece_id=HWYDJB4UYN6VJOKDE7QQJLO6NR4KLDTRPXGBRN44TPGKUWZLAG2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.174593113 (357h49m39.636685596s) [noise=true , address=77.90.31.19:4843 , piece_id=FSO7NG45YOWWU6TYDVLLCUB36V5LGU77AU6AAY4UH4XHH37IR4BQ, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191891133 (357h49m39.653983616s) [noise=true , address=45.91.116.8:4047 , piece_id=M2NEZNKJHPUSTRF35MVKNUNPGEGYIQKUXN6BNKNHOCERI5XTGFUA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: <nil>
Oct 8 11:20:54.191928434 (357h49m39.654020917s) [seg_pos={0 0}, upload=314829]: Segment reached optimal threshold of 13 pieces.
Oct 8 11:20:54.192102295 (357h49m39.654194778s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192112734 (357h49m39.654205207s) [noise=true , address=45.91.116.12:4226 , piece_id=HGC3INIR72NGRFUTK6IOOW56C2OZU4XEEONS5WCNR5V4PUMZ5ZMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192183920 (357h49m39.654276413s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192195783 (357h49m39.654288266s) [noise=true , address=77.90.31.21:4879 , piece_id=4HDO3JVYJT7GL56XCRVWRUD7ZC2ZZNSXMXYGMYTWFWRC22QQBWMA, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192201854 (357h49m39.654294338s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7): protocol: expected piece hash; context canceled; EOF
Oct 8 11:20:54.192210090 (357h49m39.654302573s) [noise=true , address=45.91.116.6:4975 , piece_id=QFB4MFQCVS675GFFFGO22XIFLGPI4SMHAM5ZH2HUCKAUAZBU4G2A, seg_pos={0 0}, upload=314829]: Long tail cancellation due to optimal threshold
Oct 8 11:20:54.192228514 (357h49m39.654320998s) [seg_pos={0 0}, upload=314829]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 8 11:20:54.192306584 (357h49m39.654399087s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 8 11:20:54.192313827 (357h49m39.654406311s) [upload=314829]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 8 11:20:54.555415764 (357h49m40.017508258s) [upload=314829]: Done uploading segments...
Oct 8 11:20:54.555441313 (357h49m40.017533796s) [upload=314829]: Upload finished. err: <nil>
Duration: 30.002072016s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.785788114s
FAIL (2025-10-08 09:13:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.785813865s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
6.247974233s
FAIL (2025-10-08 09:12:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.24804609s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.094565546s
FAIL (2025-10-08 09:11:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.094600523s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
6.318469797s
FAIL (2025-10-08 09:10:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.318519411s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
6.445850898s
FAIL (2025-10-08 09:09:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.44589904s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
6.188245083s
FAIL (2025-10-08 09:08:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.188288185s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.228269929s
FAIL (2025-10-08 09:07:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.228308743s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.119670174s
FAIL (2025-10-08 09:06:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.119700933s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
6.230585109s
FAIL (2025-10-08 09:06:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.230619545s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.125798816s
FAIL (2025-10-08 09:05:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.125838932s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
6.688770158s
FAIL (2025-10-08 09:04:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.688804704s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
6.021907226s
FAIL (2025-10-08 09:04:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.021941762s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
6.24124056s
FAIL (2025-10-08 09:03:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.241279353s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.146284324s
FAIL (2025-10-08 09:02:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.1463348s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
6.117822868s
FAIL (2025-10-08 09:01:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.117896708s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
6.228844729s
FAIL (2025-10-08 09:01:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.228878624s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
6.3610013s
FAIL (2025-10-08 09:00:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.361037548s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
6.40203937s
FAIL (2025-10-08 08:59:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.402074004s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
6.055970932s
FAIL (2025-10-08 08:58:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.056006298s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
6.099075373s
FAIL (2025-10-08 08:58:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.099107664s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.96791153s
FAIL (2025-10-08 08:57:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 5.967939143s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
6.045660403s
FAIL (2025-10-08 08:57:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.045691382s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.08799018s
FAIL (2025-10-08 08:57:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.088034264s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.954201953s
FAIL (2025-10-08 08:56:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 5.954288218s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.960850233s
FAIL (2025-10-08 08:55:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 5.960885731s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.987002016s
FAIL (2025-10-08 08:55:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 5.9870348s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
6.071625287s
FAIL (2025-10-08 08:55:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.071655315s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
6.113526538s
FAIL (2025-10-08 08:54:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.113561706s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
6.183486489s
FAIL (2025-10-08 08:53:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.183553266s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
6.142159419s
FAIL (2025-10-08 08:52:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.142349521s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
6.208059395s
FAIL (2025-10-08 08:52:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.20810904s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.026597448s
FAIL (2025-10-08 08:51:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.026625211s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.063316904s
FAIL (2025-10-08 08:51:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.063378482s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
6.102706231s
FAIL (2025-10-08 08:50:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.102741628s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.941340078s
FAIL (2025-10-08 08:49:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 5.941372401s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.979127178s
FAIL (2025-10-08 08:48:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 5.979160611s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
6.084722118s
FAIL (2025-10-08 08:47:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 7)
======LOGS======
5082268 (354h59m9.767174762s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305522556 (354h59m9.767615029s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.305954289 (354h59m9.768046772s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.306456154 (354h59m9.768548637s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.307488350 (354h59m9.769580823s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.308950484 (354h59m9.771042967s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.311635346 (354h59m9.773727829s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.313993647 (354h59m9.77608613s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.315440062 (354h59m9.777532535s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.316749685 (354h59m9.778842158s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:24.319455708 (354h59m9.781548191s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Uploading piece...
Oct 8 08:30:26.091049946 (354h59m11.553142429s) [upload=312360]: Next returned nil segment
Oct 8 08:30:26.091071688 (354h59m11.553164171s) [upload=312360]: Waiting for error group managing segments...
Oct 8 08:30:26.403864136 (354h59m11.865956619s) [noise=true , address=77.90.31.15:4697 , piece_id=ZCJKCENWRPBFBXQQITLXCJEF5DN7KCPUS2EQBYTLKEZG5KR7AEJA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.412151357 (354h59m11.87424383s) [noise=true , address=45.91.116.9:4262 , piece_id=3VNL7ONEM3SOPF6STFB35FB25WVPKBMDNALE2ALF7SKOGXAPIM2A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.442848390 (354h59m11.904940873s) [noise=true , address=45.91.116.5:4299 , piece_id=QBRIOY7OWCR5R3C7VDXKSAA2ZGOBGMXELWLPXUDQGX2H2VZQASOQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.466560753 (354h59m11.928653236s) [noise=true , address=45.91.116.10:4082 , piece_id=UZ3I23ZLBOJV2WBURDYFASEIZ5OXSVEXCOQ72DEIHZE6MYEGDZ6Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:26.507933205 (354h59m11.970025678s) [noise=true , address=77.90.31.16:4734 , piece_id=KT4TXZ5XRRVD2YOB5DMRWLIAIKAPA724ZS4RM24SN5XDQCBUI55Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:35.977992857 (354h59m21.44008534s) [noise=true , address=145.79.227.18:4007 , piece_id=A2ISHPR2ZVQASWHN4H3BRPD2RXMD7ZD6DPSEYPCFHOCOOBH6SX4Q, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:47.322022261 (354h59m32.784114734s) [noise=true , address=145.79.227.13:4803 , piece_id=GBLR7HEOH4FI5J33G55ECJGNXH3UOZWKMKNR3QSA5VACOESYUBEQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: <nil>
Oct 8 08:30:53.351303115 (354h59m38.813395598s) [noise=true , address=145.79.227.2:4114 , piece_id=EPTJEOCD4Z2OVTTEQJR6FFIS5NHYCVBEOKUDRFA4PBAFTB6PCB4A, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57702->145.79.227.2:4114: use of closed network connection
Oct 8 08:30:53.351346046 (354h59m38.813438539s) [noise=true , address=145.79.227.5:4221 , piece_id=CJPX42GNDPTCJIBXQJWOW67OUOBSF5MCP2IDTR6DUXWWSKY5VKWA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52526->145.79.227.5:4221: use of closed network connection
Oct 8 08:30:53.351385812 (354h59m38.813478285s) [noise=true , address=145.79.227.7:4294 , piece_id=JM5FE7K273MPOYD52RAWXN5CMFPCMZ6UP25LKSBA74DJDVXFJ7EQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54980->145.79.227.7:4294: use of closed network connection
Oct 8 08:30:53.351444614 (354h59m38.813537097s) [noise=true , address=145.79.227.2:4115 , piece_id=KMZ76RJ7BSJBISDWNUPS25ZTLPFF4KKDBNHANHODXMK5JPQA5NCQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52740->145.79.227.2:4115: use of closed network connection
Oct 8 08:30:53.351453100 (354h59m38.813545583s) [noise=true , address=145.79.227.16:4911 , piece_id=C53C5KXNZLKYLUMKXGOSRJBAUOV5HHAPMGTBRW5HJXEEMYRSFKGA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45106->145.79.227.16:4911: use of closed network connection
Oct 8 08:30:53.351531771 (354h59m38.813624254s) [noise=true , address=145.79.227.15:4873 , piece_id=XRNTQ3WUMDDTAS3CGP6CX7OH63WP5ISVTEKPQH62R5I6EHGRWAAA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38094->145.79.227.15:4873: use of closed network connection
Oct 8 08:30:53.351542391 (354h59m38.813634874s) [noise=true , address=145.79.227.19:4078 , piece_id=YIE6P42KGKIC6QWAFJSCIBX6JHV7R26RZ5GILXDZ7BRWIKMAJ6LA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38282->145.79.227.19:4078: use of closed network connection
Oct 8 08:30:53.351627983 (354h59m38.813720456s) [noise=true , address=145.79.227.17:4970 , piece_id=E5EMINOP6LGIKDQJFQR7JWA6EPFAP3RK77YNXYDJ3EEYK3RWURBQ, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56822->145.79.227.17:4970: use of closed network connection
Oct 8 08:30:53.351651809 (354h59m38.813744282s) [noise=true , address=145.79.227.6:4259 , piece_id=PNR7EC3Z5GKR52UQYODOEQVFOR2WG4O626FFQJHTPFAMZN2654KA, seg_pos={0 0}, upload=312360]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51060->145.79.227.6:4259: use of closed network connection
Oct 8 08:30:53.351676957 (354h59m38.81376944s) [seg_pos={0 0}, upload=312360]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil>
Oct 8 08:30:53.594905273 (354h59m39.056997756s) [upload=312360]: Done uploading segments...
Oct 8 08:30:53.594936612 (354h59m39.057029085s) [upload=312360]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7)
Duration: 6.084753998s
core
uplink
us-select-1
|