Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.915461793s FAIL (2025-07-16 07:43:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.915494486s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.886311838s FAIL (2025-07-16 07:42:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.88633841s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.863240775s FAIL (2025-07-16 07:41:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.863267888s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.907736463s FAIL (2025-07-16 07:40:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.907760609s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.788647405s FAIL (2025-07-16 07:39:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.78867525s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.897602049s FAIL (2025-07-16 07:39:09 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.89762882s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.784556879s FAIL (2025-07-16 07:38:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.784586176s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.909878329s FAIL (2025-07-16 07:37:40 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.909897215s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.7617156s FAIL (2025-07-16 07:36:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.761743173s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 7.82849659s FAIL (2025-07-16 07:36:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 7.828516508s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.865883632s FAIL (2025-07-16 07:35:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.865908069s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.84779188s FAIL (2025-07-16 07:35:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.847819464s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.859642968s FAIL (2025-07-16 07:34:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.859673196s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.855460881s FAIL (2025-07-16 07:34:12 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.85552844s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.79948517s FAIL (2025-07-16 07:33:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.799506611s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.834898147s FAIL (2025-07-16 07:32:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.834921171s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.776168023s FAIL (2025-07-16 07:31:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.776217268s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.945510329s FAIL (2025-07-16 07:30:40 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.945542231s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 16.927080058s FAIL (2025-07-16 07:30:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 16.927114365s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X..........................................X................] duration: 5.711864501s FAIL (2025-07-16 07:29:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.711884449s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X..........................................X...............] duration: 5.870448302s FAIL (2025-07-16 07:29:00 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.870474992s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X..........................................X..............] duration: 5.830088024s FAIL (2025-07-16 07:28:27 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.830113252s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X..........................................X.............] duration: 5.861580898s FAIL (2025-07-16 07:27:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.861609684s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X..........................................X............] duration: 5.911161745s FAIL (2025-07-16 07:27:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.911191271s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X..........................................X...........] duration: 5.82186781s FAIL (2025-07-16 07:26:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.821897258s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X..........................................X..........] duration: 6.229589909s FAIL (2025-07-16 07:25:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.229616961s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X..........................................X.........] duration: 6.055805534s FAIL (2025-07-16 07:24:24 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.055830702s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X..........................................X........] duration: 5.851311989s FAIL (2025-07-16 07:23:20 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.851332859s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X..........................................X.......] duration: 5.998347297s FAIL (2025-07-16 07:22:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.998376071s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X..........................................X......] duration: 5.858325478s FAIL (2025-07-16 07:21:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.858352469s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X..........................................X.....] duration: 5.802238667s FAIL (2025-07-16 07:20:39 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.802262742s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X..........................................X....] duration: 5.973252285s FAIL (2025-07-16 07:20:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.973280519s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X..........................................X...] duration: 6.121443829s FAIL (2025-07-16 07:19:25 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.121480989s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X..........................................X..] duration: 5.812098608s FAIL (2025-07-16 07:18:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.812124035s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X..........................................X.] duration: 5.910509942s FAIL (2025-07-16 07:17:39 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.910540102s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X..........................................X] duration: 30.241314294s FAIL (2025-07-16 07:16:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== ]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 07:15:30.670329602 (550h5m5.440970937s) [upload=439963]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 07:15:30.670333840 (550h5m5.440975175s) [upload=439963]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 07:15:31.037176180 (550h5m5.807817515s) [upload=439963]: Done uploading segments... Jul 16 07:15:31.037192481 (550h5m5.807833816s) [upload=439963]: Upload finished. err: <nil> Jul 16 07:16:26.141279228 (550h6m0.911920563s) [upload=439972]: Starting upload Jul 16 07:16:26.141337289 (550h6m0.911978624s) [upload=439972]: Done starting upload Jul 16 07:16:26.141414086 (550h6m0.912055421s) [upload=439972]: Uploading segments... Jul 16 07:16:26.141498438 (550h6m0.912139773s) [upload=439972]: Got next segment. Inline: false Jul 16 07:16:26.141527563 (550h6m0.912168898s) [upload=439972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 07:16:26.141532352 (550h6m0.912173687s) [upload=439972]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 07:16:26.387810013 (550h6m1.158451349s) [seg_pos={0 0}, upload=439972]: Begin upload segment... Jul 16 07:16:26.387861622 (550h6m1.158502957s) [seg_pos={0 0}, upload=439972]: Done begin upload segment. Jul 16 07:16:26.387881170 (550h6m1.158522505s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.387891469 (550h6m1.158532804s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388418347 (550h6m1.159059692s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388553045 (550h6m1.15919438s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.388738039 (550h6m1.159379374s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389036210 (550h6m1.159677555s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389074192 (550h6m1.159715537s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389356773 (550h6m1.159998108s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389666505 (550h6m1.16030784s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.389995464 (550h6m1.160636799s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390315076 (550h6m1.160956411s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390629748 (550h6m1.161271083s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.390961443 (550h6m1.161602779s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391269994 (550h6m1.161911329s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391287136 (550h6m1.161928471s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:26.391562964 (550h6m1.162204299s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Uploading piece... Jul 16 07:16:28.097522755 (550h6m2.86816408s) [upload=439972]: Next returned nil segment Jul 16 07:16:28.097536410 (550h6m2.868177745s) [upload=439972]: Waiting for error group managing segments... Jul 16 07:16:28.443256546 (550h6m3.213897881s) [noise=true , address=45.91.116.9:4262 , piece_id=6SIQTLHAZIFNCLKAIGYDT5E2MEJOL5AYU53KHJ3E7CFUII7TOFLQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.443612908 (550h6m3.214254243s) [noise=true , address=104.36.82.15:4257 , piece_id=GSO5VDQPEFQEQS3K5RE2IFJDD44QNEGYT37MABJRL6IUR4QKRSUA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.452354063 (550h6m3.222995398s) [noise=true , address=45.91.116.7:4011 , piece_id=PAY5TW7MTQMCEJGJQLEZHOIPALLTGL32XWSIHKWAPHCKGC4HZWWA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.455240004 (550h6m3.22588133s) [noise=true , address=104.36.82.4:4802 , piece_id=3QFJ226OZEPUS4M4SOEH5WR34UQAQJUEN5DYXL6CTNCHC23PFMEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.516897034 (550h6m3.28753837s) [noise=true , address=104.36.82.15:4258 , piece_id=3P4DX3R4NUT3CHWPCTZM6JQJSVUVV7WCNQC3R3OTSIFNWW2YQFHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.520076909 (550h6m3.290718244s) [noise=true , address=45.91.116.10:4082 , piece_id=EKGKMBPPUW546X56QOQBJKFUF3ZEDCC7FBNXVIGK6H4ASQNBGOCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.526746490 (550h6m3.297387825s) [noise=true , address=104.36.82.7:4911 , piece_id=PXX5CVBX2STHL7ADJCSURJ3RMP2XTE67AAXNUNFUDLQT3DFBEW5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.531731768 (550h6m3.302373103s) [noise=true , address=45.91.116.5:4297 , piece_id=EPARBDZL267E7JMG6Z3O7O6LKUUYQ5UER2YJ2EY7R4R2FDHVAJ5A, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.535121835 (550h6m3.30576317s) [noise=true , address=104.36.82.9:4006 , piece_id=TSIRZ73376HNFDZTOGLGA3DY4YYRBGIEMKN26X2MVZVXTVW4QKMA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:28.537995282 (550h6m3.308636618s) [noise=true , address=45.91.116.13:4153 , piece_id=EUFVSQ3NZYYYOSXA4TFDVZWIPBREJB3S7SQMAOJQJ2QE6WX3CIAQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:47.015597962 (550h6m21.786239297s) [noise=true , address=77.90.31.11:4553 , piece_id=NIF4ZAQ5EFO43T7ARDL6HXSCY6EFBG7RMHKFNCVCMXU5PDF3MPBQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:53.793163570 (550h6m28.563804905s) [noise=true , address=77.90.31.11:4554 , piece_id=LHSN7KOLRT22Q7NNEB5RQNEFDQ4IIY3QUTXX5HCAM7IBOGS46FEQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: <nil> Jul 16 07:16:55.462521041 (550h6m30.233162376s) [noise=true , address=77.90.31.12:4592 , piece_id=3DMXCH3QSPBBMOLFI2EHKBKJPVMGPPJ77IRNZK6O4G27FKUAY6NA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 07:16:55.462563902 (550h6m30.233205237s) [noise=true , address=77.90.31.15:4698 , piece_id=PN36J7QXWABEWU2EXU2G5GDF4CMRUHF4SWZOKAVYOFXL54HD66VQ, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42394->77.90.31.15:4698: use of closed network connection Jul 16 07:16:55.462588419 (550h6m30.233229754s) [noise=true , address=77.90.31.19:4843 , piece_id=Q6UY6TXDDRPPO67O4KSRYLJ4DYYHDGLIY7KTYHQS65HHQWKYLQHA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34274->77.90.31.19:4843: use of closed network connection Jul 16 07:16:55.462604440 (550h6m30.233245765s) [noise=true , address=77.90.31.10:4518 , piece_id=KQC3JEKH4CFPE3KXTV4LADBDLIJ6IIROOVPA3Y6CFVM6ZBVUAXCA, seg_pos={0 0}, upload=439972]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55992->77.90.31.10:4518: use of closed network connection Jul 16 07:16:55.462626863 (550h6m30.233268198s) [seg_pos={0 0}, upload=439972]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 16 07:16:55.702313482 (550h6m30.472954817s) [upload=439972]: Done uploading segments... Jul 16 07:16:55.702339622 (550h6m30.472980957s) [upload=439972]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.241408654s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.010251651s FAIL (2025-07-16 07:15:33 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 6.010281138s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.855618073s FAIL (2025-07-16 07:15:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.855648652s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.849098251s FAIL (2025-07-16 07:14:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.849128529s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.845990259s FAIL (2025-07-16 07:13:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.846018362s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.832024371s FAIL (2025-07-16 07:13:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.83207615s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.956798829s FAIL (2025-07-16 07:12:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.956822846s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.842112436s FAIL (2025-07-16 07:12:00 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.842141001s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.807595158s FAIL (2025-07-16 07:11:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.807623593s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.823759136s FAIL (2025-07-16 07:10:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.823788412s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.98125799s FAIL (2025-07-16 07:09:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.981282206s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.839497518s FAIL (2025-07-16 07:09:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.839530142s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.97414533s FAIL (2025-07-16 07:08:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.974169406s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.950295685s FAIL (2025-07-16 07:07:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.950317806s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.913039281s FAIL (2025-07-16 07:06:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== pload=439555]: Uploading segments... Jul 16 06:44:22.918321671 (549h33m57.688963006s) [upload=439555]: Got next segment. Inline: false Jul 16 06:44:22.918372578 (549h33m57.689013903s) [upload=439555]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 06:44:22.918377177 (549h33m57.689018512s) [upload=439555]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 06:44:23.212169467 (549h33m57.982810802s) [seg_pos={0 0}, upload=439555]: Begin upload segment... Jul 16 06:44:23.212222499 (549h33m57.982863834s) [seg_pos={0 0}, upload=439555]: Done begin upload segment. Jul 16 06:44:23.212252907 (549h33m57.982894242s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212368247 (549h33m57.983009612s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212607034 (549h33m57.983248369s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.212860559 (549h33m57.983501894s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213111439 (549h33m57.983752774s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213418477 (549h33m57.984059812s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213639550 (549h33m57.984280885s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.213747427 (549h33m57.984388762s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214140088 (549h33m57.984781433s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214482392 (549h33m57.985123717s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214500978 (549h33m57.985142313s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.214692394 (549h33m57.985333719s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215022897 (549h33m57.985664232s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.215470854 (549h33m57.986112189s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216061164 (549h33m57.986702499s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:23.216508439 (549h33m57.987149764s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Uploading piece... Jul 16 06:44:24.966908298 (549h33m59.737549653s) [upload=439555]: Next returned nil segment Jul 16 06:44:24.966930421 (549h33m59.737571756s) [upload=439555]: Waiting for error group managing segments... Jul 16 06:44:25.260165444 (549h34m0.030806769s) [noise=true , address=104.36.82.2:4730 , piece_id=KU6EXILLOB24NJ7GTWT5743LVAQY7MGQJ2M3U2OEF3K6EOKRK2HQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.268158397 (549h34m0.038799732s) [noise=true , address=104.36.82.13:4187 , piece_id=MQDMKIO5IYUDTLTQQ3FDKUL2ZUBWYK4NM3MTD4QHAZIHWHCGBE2A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.269835636 (549h34m0.040476961s) [noise=true , address=45.91.116.9:4261 , piece_id=HJH5QA2KAZQWPZGWNCXZ57APLVWZNFV2TPZTMAPVCT6CFMAX4JNA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.272806550 (549h34m0.043447875s) [noise=true , address=104.36.82.10:4077 , piece_id=66UKZGU2TS2JFTZORP27STFLPFHSMS4VVCLSPGNOXRPT4RCB7LJQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.273974596 (549h34m0.044615931s) [noise=true , address=45.91.116.10:4083 , piece_id=BQNAZSCOU6GITQOIFSBI4JN7X4XNABLGKCHZEU7S4T5NUCOU4VGQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.278977287 (549h34m0.049618622s) [noise=true , address=45.91.116.11:4119 , piece_id=LFGRM2SOZVGJUBUTREKNYNBQETVQYNLBVVDNN2ICGIVIEB45QRYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.359206933 (549h34m0.129848258s) [noise=true , address=45.91.116.6:4974 , piece_id=WPML5LVF6ZBOOFYJNZOJILFECI75CGTVKCKTSKIST6RCTUSR3IJA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.360411157 (549h34m0.131052502s) [noise=true , address=104.36.82.3:4767 , piece_id=TL6RSLMC725FY3BHCH33TJ3SIRJPHIU2NGS3EOVDCEOGXBACPDQA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.366092697 (549h34m0.136734032s) [noise=true , address=45.91.116.5:4298 , piece_id=KVH6RQ5E6PWRAOLXAHR4A7MRPOY6AET7BR4HCOYZAJAJ277XUPEQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429515666 (549h34m0.200157011s) [noise=true , address=104.36.82.14:4222 , piece_id=AKV5EB3SIEE3FOYC233KQ5IHURCJZARBQMTVHR4M6RKPJS723CRQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:25.429754072 (549h34m0.200395397s) [noise=true , address=104.36.82.4:4803 , piece_id=TZY3HZOBCBSZJ7EYHSE742KDCU42TDCZ4J5G3QEU7IKBCNFF5HGA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: <nil> Jul 16 06:44:52.235466243 (549h34m27.006107578s) [noise=true , address=77.90.31.19:4841 , piece_id=KS26I4ZGTI2OQ6V7F5XPB2ZKLLOPOYF3BRGO2JFQSZ4U7DQ4RW4A, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57436->77.90.31.19:4841: use of closed network connection Jul 16 06:44:52.235575973 (549h34m27.006217308s) [noise=true , address=77.90.31.17:4770 , piece_id=2347LA2Y5WQ743FOSVO4A76NIE2JXJWMWW5K2Q7C2346RV5KZ3OQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36182->77.90.31.17:4770: use of closed network connection Jul 16 06:44:52.235626319 (549h34m27.006267654s) [noise=true , address=77.90.31.14:4662 , piece_id=6U25FIZXCKRFWPI7MDXUDLH5S2SY5OYNDX2CEU2XJI3EKNUYJZFQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46616->77.90.31.14:4662: use of closed network connection Jul 16 06:44:52.235677186 (549h34m27.006318512s) [noise=true , address=77.90.31.18:4806 , piece_id=DU7AR2P7EYHX4USIMMXIJDWL5XXRQNCQZZLHFO4DTHF5W5Z32DYQ, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53692->77.90.31.18:4806: use of closed network connection Jul 16 06:44:52.235716050 (549h34m27.006357385s) [noise=true , address=77.90.31.15:4699 , piece_id=DDMVAAAMCGGLUQ2BRF5TQQDFCOV4DCCNNAI2FS4SUTMPHVWBO5BA, seg_pos={0 0}, upload=439555]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34772->77.90.31.15:4699: use of closed network connection Jul 16 06:44:52.235756929 (549h34m27.006398264s) [seg_pos={0 0}, upload=439555]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 16 06:44:52.475130338 (549h34m27.245771663s) [upload=439555]: Done uploading segments... Jul 16 06:44:52.475157399 (549h34m27.245798734s) [upload=439555]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 5.913070591s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)