Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 519722 reports (Page 5341 of 10395)
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
3 out of 60 is failed (threshold=3) [.................................................X..X.....X.]
duration:
5.876946983s
trace:
https://jaeger.dev.storj.io/trace/31941f458ea9f65a
FAIL (2025-11-18 17:36:40 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
ding piece...
Nov 18 17:35:28.303711329 (225h31m26.85518178s) [noise=true , address=89.149.201.147:4009  , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.304232181 (225h31m26.855702642s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.304696436 (225h31m26.856166897s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.305211456 (225h31m26.856681927s) [noise=true , address=89.149.201.147:4023  , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.305703353 (225h31m26.857173814s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.306160574 (225h31m26.857631045s) [noise=true , address=81.171.14.70:4042    , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.306634816 (225h31m26.858105267s) [noise=true , address=81.171.14.70:4045    , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.307024658 (225h31m26.858495119s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.307464617 (225h31m26.858935078s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:29.504130391 (225h31m28.055600842s) [upload=198621]: Next returned nil segment
Nov 18 17:35:29.504144758 (225h31m28.055615209s) [upload=198621]: Waiting for error group managing segments...
Nov 18 17:35:30.069727147 (225h31m28.621197599s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.084150733 (225h31m28.635621194s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.099921704 (225h31m28.651392165s) [noise=true , address=185.167.204.206:4037 , piece_id=OTFWNCRNWTCH44MGDC33A2TWHYZ4LX2R6WKFYLU3WV4EKEMCCK2Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.159451950 (225h31m28.710922412s) [noise=true , address=185.167.204.205:4032 , piece_id=MBXUGRQGTU5CF3OM335WD3DP2GGS4FVFQ6HR5D7A75BROHZ4QUDQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.161530518 (225h31m28.713000979s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.172390657 (225h31m28.723861108s) [noise=true , address=185.167.204.205:4031 , piece_id=SJMWKRK3BLE4MIRFCGAX4ZDX7GCSESTVITIKREP4FOBVWKSSJE5A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.573570225 (225h31m29.125040686s) [noise=true , address=185.167.204.205:4021 , piece_id=O7G5LQXEGUCYU2VM4IVPILO3V2E5DU4PPE5XI4MB5ZJ362J47L3Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.578894624 (225h31m29.130365075s) [noise=true , address=185.167.204.206:4053 , piece_id=5PQBPCIP4ZSCAJCPBIWWWBS5LP7JLV3BJPVV5YYIWAKY2W2O23YA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.604439245 (225h31m29.155909706s) [noise=true , address=185.167.204.206:4058 , piece_id=CQSCAVBSXYQMVGBBJQE2LCCCQNOY5FXOYKLUSWMNUL4LCF6THNIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.628433123 (225h31m29.179903584s) [noise=true , address=185.167.204.205:4024 , piece_id=CGXCS3ERKUTTZ6D62VOB7WI3MEGRVFENIDWWNHEEFTCTJX2J32FA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.631477531 (225h31m29.182947992s) [noise=true , address=185.167.204.205:4034 , piece_id=SGLUECYAWO2SW4Q2YVEFFZ35NTGNHRVF2BYRIDAZXK7CFJNO44PA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.642265493 (225h31m29.193735944s) [noise=true , address=185.167.204.205:4007 , piece_id=RMHYVKJMW7U7UHFXYDHQGNBZL7JRCLB2AJHFEBFZCTS5MSBJKAHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.701042125 (225h31m29.252512586s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.722478021 (225h31m29.273948482s) [noise=true , address=89.149.201.147:4011  , piece_id=AV224HW4PGZLFKXBPKWHXG4TWN4F5ZM4B4UF6HS2Z32UVXIBPSNA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.725432207 (225h31m29.276902668s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.735732180 (225h31m29.287202641s) [noise=true , address=89.149.201.147:4020  , piece_id=M4OU6AP6SWPMYLSKNQ2PNJ3V3W4N2AE6XIANRAW3IZRE7WYUR34Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.773720156 (225h31m29.325190627s) [noise=true , address=89.149.201.147:4023  , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.812117852 (225h31m29.363588313s) [noise=true , address=89.149.201.147:4022  , piece_id=QHROD3GYRYXIU4X5W3KPF3AVOEQ2WZAMC3DMKYNOK4SJJOJNQ6IQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.854765841 (225h31m29.406236312s) [noise=true , address=89.149.201.147:4009  , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:31.353867089 (225h31m29.90533755s) [noise=true , address=89.149.201.147:4015  , piece_id=N2BALULCQ7GP7TNMCNP5SI6G44NYF7RKLNTBWZIPGKRC2ATHHA4A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:36:24.147864663 (225h32m22.699335125s) [noise=true , address=81.171.14.70:4028    , piece_id=FPWX262BM6AZLRSWNITL5P3ECXNAWTBTDLTFE5RUE2EMH3TCVA4Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:36:27.500587454 (225h32m26.052057915s) [noise=true , address=81.171.14.70:4040    , piece_id=MCHKPFQFIA4AKTCRVO7DTXRCZ3GUOH4ALNY6JPS6WAI7H74XEFUA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:36:27.651753240 (225h32m26.203223721s) [noise=true , address=81.171.14.70:4037    , piece_id=FUH75TWEV2BH4I73OUVUIQI35FFZ5H4YUNUBDWAPFOA6HTERMBFQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:36:27.652015570 (225h32m26.203486041s) [noise=true , address=81.171.14.70:4042    , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:36:27.652354636 (225h32m26.203825097s) [noise=true , address=81.171.14.70:4045    , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:36:27.652587198 (225h32m26.204057659s) [noise=true , address=81.171.14.70:4044    , piece_id=PLS4BU4CVPO4JUIAGXNLQ5KW5UFRADBQ6PHHP74LWDKZESXVVYLQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:44480->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:36:27.652981730 (225h32m26.204452181s) [noise=true , address=81.171.14.70:4047    , piece_id=626ASW3GOUBI3VKEMCZARE4Q3UJWFPOLHUFHFHOLNBLSOYWA32XA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:38640->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:36:27.653187582 (225h32m26.204658043s) [noise=true , address=81.171.14.70:4027    , piece_id=YD5OIFIOE3465W7TX3643XNZ3G7ZE7UOENPGH73NF4HLUGZENQ2A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:49056->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:36:27.653225674 (225h32m26.204696135s) [seg_pos={0 0}, upload=198621]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Nov 18 17:36:27.832225291 (225h32m26.383695752s) [upload=198621]: Done uploading segments...
Nov 18 17:36:27.832274845 (225h32m26.383745306s) [upload=198621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 5.87698315s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
3 out of 60 is failed (threshold=3) [..................................................X..X.....X]
duration:
1m0.183093798s
trace:
https://jaeger.dev.storj.io/trace/31941f458ea9f65a
FAIL (2025-11-18 17:36:27 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
ding piece...
Nov 18 17:35:28.303711329 (225h31m26.85518178s) [noise=true , address=89.149.201.147:4009  , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.304232181 (225h31m26.855702642s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.304696436 (225h31m26.856166897s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.305211456 (225h31m26.856681927s) [noise=true , address=89.149.201.147:4023  , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.305703353 (225h31m26.857173814s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.306160574 (225h31m26.857631045s) [noise=true , address=81.171.14.70:4042    , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.306634816 (225h31m26.858105267s) [noise=true , address=81.171.14.70:4045    , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.307024658 (225h31m26.858495119s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:28.307464617 (225h31m26.858935078s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Uploading piece...
Nov 18 17:35:29.504130391 (225h31m28.055600842s) [upload=198621]: Next returned nil segment
Nov 18 17:35:29.504144758 (225h31m28.055615209s) [upload=198621]: Waiting for error group managing segments...
Nov 18 17:35:30.069727147 (225h31m28.621197599s) [noise=true , address=185.167.204.205:4013 , piece_id=6KEJSZWWRSUXKN64ILKWVRBRVYT35YQZZJGFGYLUJLEIHXIXMJFA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.084150733 (225h31m28.635621194s) [noise=true , address=185.167.204.206:4044 , piece_id=UD3VF5FH247MBDCQ2BEKG77LQYPVL4IZGSQ2L3KMY4YYRZD4QVUQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.099921704 (225h31m28.651392165s) [noise=true , address=185.167.204.206:4037 , piece_id=OTFWNCRNWTCH44MGDC33A2TWHYZ4LX2R6WKFYLU3WV4EKEMCCK2Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.159451950 (225h31m28.710922412s) [noise=true , address=185.167.204.205:4032 , piece_id=MBXUGRQGTU5CF3OM335WD3DP2GGS4FVFQ6HR5D7A75BROHZ4QUDQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.161530518 (225h31m28.713000979s) [noise=true , address=185.167.204.205:4001 , piece_id=F45TWM4YV3BDYRQRO5BZXPCP7ZQ2XR2QQYSO5NW32O3GVXOMNW7A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.172390657 (225h31m28.723861108s) [noise=true , address=185.167.204.205:4031 , piece_id=SJMWKRK3BLE4MIRFCGAX4ZDX7GCSESTVITIKREP4FOBVWKSSJE5A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.573570225 (225h31m29.125040686s) [noise=true , address=185.167.204.205:4021 , piece_id=O7G5LQXEGUCYU2VM4IVPILO3V2E5DU4PPE5XI4MB5ZJ362J47L3Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.578894624 (225h31m29.130365075s) [noise=true , address=185.167.204.206:4053 , piece_id=5PQBPCIP4ZSCAJCPBIWWWBS5LP7JLV3BJPVV5YYIWAKY2W2O23YA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.604439245 (225h31m29.155909706s) [noise=true , address=185.167.204.206:4058 , piece_id=CQSCAVBSXYQMVGBBJQE2LCCCQNOY5FXOYKLUSWMNUL4LCF6THNIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.628433123 (225h31m29.179903584s) [noise=true , address=185.167.204.205:4024 , piece_id=CGXCS3ERKUTTZ6D62VOB7WI3MEGRVFENIDWWNHEEFTCTJX2J32FA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.631477531 (225h31m29.182947992s) [noise=true , address=185.167.204.205:4034 , piece_id=SGLUECYAWO2SW4Q2YVEFFZ35NTGNHRVF2BYRIDAZXK7CFJNO44PA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.642265493 (225h31m29.193735944s) [noise=true , address=185.167.204.205:4007 , piece_id=RMHYVKJMW7U7UHFXYDHQGNBZL7JRCLB2AJHFEBFZCTS5MSBJKAHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.701042125 (225h31m29.252512586s) [noise=true , address=185.167.204.206:4038 , piece_id=ZP6L7IUNQXWN4VKJDH7W2QLFZPLPLMJR7NSXDOUIUSDCV5BJZGQA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.722478021 (225h31m29.273948482s) [noise=true , address=89.149.201.147:4011  , piece_id=AV224HW4PGZLFKXBPKWHXG4TWN4F5ZM4B4UF6HS2Z32UVXIBPSNA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.725432207 (225h31m29.276902668s) [noise=true , address=185.167.204.205:4003 , piece_id=TZL6XOFABHGW4G3UAJZNLCL663C4Q2Y672CY4WP6NZSA6T45IWRA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.735732180 (225h31m29.287202641s) [noise=true , address=89.149.201.147:4020  , piece_id=M4OU6AP6SWPMYLSKNQ2PNJ3V3W4N2AE6XIANRAW3IZRE7WYUR34Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.773720156 (225h31m29.325190627s) [noise=true , address=89.149.201.147:4023  , piece_id=GVRLCBBZV62ZJHAPNRHFNOYQGC7QQF6ACQ7FNILSTAACQBSATHCA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.812117852 (225h31m29.363588313s) [noise=true , address=89.149.201.147:4022  , piece_id=QHROD3GYRYXIU4X5W3KPF3AVOEQ2WZAMC3DMKYNOK4SJJOJNQ6IQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:30.854765841 (225h31m29.406236312s) [noise=true , address=89.149.201.147:4009  , piece_id=PXDFF6CEU7O3DXO7ADGOJJLQTC2UTNYAAKF63UNTV4I7QODSBSIQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:35:31.353867089 (225h31m29.90533755s) [noise=true , address=89.149.201.147:4015  , piece_id=N2BALULCQ7GP7TNMCNP5SI6G44NYF7RKLNTBWZIPGKRC2ATHHA4A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:36:24.147864663 (225h32m22.699335125s) [noise=true , address=81.171.14.70:4028    , piece_id=FPWX262BM6AZLRSWNITL5P3ECXNAWTBTDLTFE5RUE2EMH3TCVA4Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:36:27.500587454 (225h32m26.052057915s) [noise=true , address=81.171.14.70:4040    , piece_id=MCHKPFQFIA4AKTCRVO7DTXRCZ3GUOH4ALNY6JPS6WAI7H74XEFUA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: <nil>
Nov 18 17:36:27.651753240 (225h32m26.203223721s) [noise=true , address=81.171.14.70:4037    , piece_id=FUH75TWEV2BH4I73OUVUIQI35FFZ5H4YUNUBDWAPFOA6HTERMBFQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:36:27.652015570 (225h32m26.203486041s) [noise=true , address=81.171.14.70:4042    , piece_id=UMPTD5XXFTSJ5RYXNAU2ZSIM4Z4HKXUZC6BY5C72MIFVS667L26Q, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:36:27.652354636 (225h32m26.203825097s) [noise=true , address=81.171.14.70:4045    , piece_id=PBDIETRQZBED7CDXVXVNEUIXJHPVT6L2ZLG57IOBRKBW3ATO6NHA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: rpc: dial tcp 81.171.14.70:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:36:27.652587198 (225h32m26.204057659s) [noise=true , address=81.171.14.70:4044    , piece_id=PLS4BU4CVPO4JUIAGXNLQ5KW5UFRADBQ6PHHP74LWDKZESXVVYLQ, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:44480->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:36:27.652981730 (225h32m26.204452181s) [noise=true , address=81.171.14.70:4047    , piece_id=626ASW3GOUBI3VKEMCZARE4Q3UJWFPOLHUFHFHOLNBLSOYWA32XA, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:38640->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:36:27.653187582 (225h32m26.204658043s) [noise=true , address=81.171.14.70:4027    , piece_id=YD5OIFIOE3465W7TX3643XNZ3G7ZE7UOENPGH73NF4HLUGZENQ2A, seg_pos={0 0}, upload=198621]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:49056->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:36:27.653225674 (225h32m26.204696135s) [seg_pos={0 0}, upload=198621]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Nov 18 17:36:27.832225291 (225h32m26.383695752s) [upload=198621]: Done uploading segments...
Nov 18 17:36:27.832274845 (225h32m26.383745306s) [upload=198621]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 1m0.183123465s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [...................................................X..X.....]
duration:
6.239540346s
trace:
https://jaeger.dev.storj.io/trace/51a555b4d737a62f
FAIL (2025-11-18 17:34:39 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
rror group managing segments...
Nov 18 17:30:31.318695700 (225h26m29.870166161s) [noise=true , address=185.167.204.206:4065 , piece_id=OXQDGJBY7DX7OIPFSNV44WEBATH4IMPDH5G5ACM5HUICBKUJVX3Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.440603995 (225h26m29.992074446s) [noise=true , address=185.167.204.205:4003 , piece_id=S6UJTQ35ESOEYBFQYDO3HRDMWV2BQYW3I6KJLH7TBOHNXJW2HZ4A, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.478224401 (225h26m30.029694862s) [noise=true , address=185.167.204.205:4027 , piece_id=C5UQ3RIEW6TTUU33EYOJQJ5IWCGHJNQJ4VJFEPP3TVKXSQV3DA2Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.493526009 (225h26m30.04499646s) [noise=true , address=185.167.204.205:4028 , piece_id=R63PZOV3I5IU4E2NAWZWINZRO7PFMNGAC2Y5ET6XZ6QKC6QLZTSQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.979142178 (225h26m30.530612639s) [noise=true , address=89.149.201.147:4012  , piece_id=V75Q2AOVYTHVE2LIVM2RY2YEVQTWDL7YB2MOIK5Z43EBCLRZ2YTA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.007153356 (225h26m30.558623827s) [noise=true , address=89.149.201.147:4009  , piece_id=OUUHVFVJRLMWU6MPENCT6GDGVV7JNWSKGEGMNXJBH4MQBVJFMPKQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.134864039 (225h26m30.686334491s) [noise=true , address=185.167.204.206:4045 , piece_id=Z6MM74QOT75EG4DOZEY3UFK6EWI5Z4ZLFATHCS6GNVJPROBQFISQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.305662020 (225h26m30.857132481s) [noise=true , address=185.167.204.206:4047 , piece_id=VHMEXXIXEHUVPELR7T24LQK2KWGV62BVM2HANBGBWOZPDTU2B6ZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.422165473 (225h26m30.973635934s) [noise=true , address=185.167.204.206:4057 , piece_id=52GMFUDKI4ZPQTSFEPLT6LCJCBGNI6XRXA5PMFIZCBUQZFTQOSZA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.632759982 (225h26m31.184230433s) [noise=true , address=185.167.204.205:4016 , piece_id=MHOFTLZ5RVHUY3YCTVPHWEGC737AB5YZN32XKUPUAQIGVZEZPLYA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.889540237 (225h26m31.441010698s) [noise=true , address=185.167.204.206:4044 , piece_id=4RORV6AMLX5VKPNTNJ4JRJNXNN73W3ISNIPP3E7ZXDQE5DIXBLGQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.997715453 (225h26m31.549185914s) [noise=true , address=185.167.204.205:4024 , piece_id=AJZPVQ4K7Z5L2URZMYF35G4FDBWYMOEC6OQAKTGYJOG4262IWIQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.520363487 (225h26m32.071833948s) [noise=true , address=185.167.204.206:4062 , piece_id=WWRYTWVHBYPV34KCOXVB5AX7CXOSSQ6SYZD7JXN4WRRG4DUTQ6QA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.945172088 (225h26m32.496642549s) [noise=true , address=185.167.204.205:4031 , piece_id=34WD55UDLX42Y6FNMYM2NDGLUEN45QZXQUDPPMHKZ37KBYSGARMA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.957641322 (225h26m32.509111783s) [noise=true , address=185.167.204.206:4059 , piece_id=FE6DUGRFYURFONXYADJJCF2H3SIE2DLTBGSRWJWI2T7H6I32HBKA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:34.696744055 (225h26m33.248214516s) [noise=true , address=185.167.204.206:4037 , piece_id=PMTC5I64DKRDHZ3JB7MVAUITEKSBKOFOLE34P43B7P4YX4DRR2RQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:34.785216973 (225h26m33.336687434s) [noise=true , address=185.167.204.205:4007 , piece_id=OXHTASGXIWNEHPW7AXB5AURSVESD3MTP4PTHZDSCP24S4JGWZIZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:31:28.781661120 (225h27m27.333131581s) [noise=true , address=81.171.14.70:4025    , piece_id=5QBQR6NS4QCLIXLL5SAJB4AOVOXPXX5RYOFAA3EMNPU4MDMJ54JQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection; write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection
Nov 18 17:31:28.781759597 (225h27m27.333230068s) [noise=true , address=81.171.14.70:4028    , piece_id=V2TXM5JZD5F3GI76XFCOTDIN77TXYAB6AGXWAWI7D2LVRVJWAEGA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection
Nov 18 17:31:28.782024943 (225h27m27.333495424s) [noise=true , address=81.171.14.70:4036    , piece_id=KHOYSS4HJX3CUEPELJ2F7D65CLHFLPPKNBKGR32FF7BKRXFCI7CQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection; write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection
Nov 18 17:31:28.782044410 (225h27m27.333514871s) [noise=true , address=81.171.14.70:4035    , piece_id=BFRV4LT3NCMILNJX4NY2VMIDQKMT4J6KIU64X4SNMVR34XGPSSGA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:31:28.782239802 (225h27m27.333710263s) [noise=true , address=81.171.14.70:4032    , piece_id=SLAQKVHSNAWOEW64XG5NOSXUTG2H7ZIEHIGF5VX7NACNHFLZWLUA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection
Nov 18 17:31:28.782697874 (225h27m27.334168335s) [noise=true , address=81.171.14.70:4031    , piece_id=P25ANJAG4YOYWTA7RQY65YU6PD6JOQ4UL6EZLDAFANGPCF26UXVA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:31:28.782898847 (225h27m27.334369308s) [noise=true , address=81.171.14.70:4040    , piece_id=427SCOPKAE4EYTSZRAK2MEDRH37FXFVU7QNIXOAADFXBABJM5P2Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection; write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection
Nov 18 17:31:28.783023484 (225h27m27.334493946s) [noise=true , address=81.171.14.70:4043    , piece_id=AKOD5NQATSK5F4RE4RYDPIKKUWXOTH2UYABRCIAPINPNQARIMZQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 188.166.225.170:57304->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783231400 (225h27m27.334701861s) [noise=true , address=81.171.14.70:4044    , piece_id=HE7KXV4Y4WDCPYMWURV42GSQF25ACIVXQDUEWXFZLPG3BRQR4HGQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:36730->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783444155 (225h27m27.334914616s) [noise=true , address=81.171.14.70:4047    , piece_id=355WXUD54HTBACHFUIJLLPG7J3HDFKIXK67XD75ZOUH4QPYGTLQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:45804->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783549546 (225h27m27.335020017s) [noise=true , address=81.171.14.70:4027    , piece_id=EJFXIFJVWRIBQHBKOX3TQU3Y7V2TRQTNAE3UHXZ5L6AGW5FLXFZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:59456->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783604971 (225h27m27.335075432s) [seg_pos={0 0}, upload=198546]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Nov 18 17:31:28.951912248 (225h27m27.503382719s) [upload=198546]: Done uploading segments...
Nov 18 17:31:28.951956402 (225h27m27.503426863s) [upload=198546]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 6.239565462s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [....................................................X..X....]
duration:
5.797934417s
trace:
https://jaeger.dev.storj.io/trace/51a555b4d737a62f
FAIL (2025-11-18 17:34:12 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
rror group managing segments...
Nov 18 17:30:31.318695700 (225h26m29.870166161s) [noise=true , address=185.167.204.206:4065 , piece_id=OXQDGJBY7DX7OIPFSNV44WEBATH4IMPDH5G5ACM5HUICBKUJVX3Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.440603995 (225h26m29.992074446s) [noise=true , address=185.167.204.205:4003 , piece_id=S6UJTQ35ESOEYBFQYDO3HRDMWV2BQYW3I6KJLH7TBOHNXJW2HZ4A, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.478224401 (225h26m30.029694862s) [noise=true , address=185.167.204.205:4027 , piece_id=C5UQ3RIEW6TTUU33EYOJQJ5IWCGHJNQJ4VJFEPP3TVKXSQV3DA2Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.493526009 (225h26m30.04499646s) [noise=true , address=185.167.204.205:4028 , piece_id=R63PZOV3I5IU4E2NAWZWINZRO7PFMNGAC2Y5ET6XZ6QKC6QLZTSQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.979142178 (225h26m30.530612639s) [noise=true , address=89.149.201.147:4012  , piece_id=V75Q2AOVYTHVE2LIVM2RY2YEVQTWDL7YB2MOIK5Z43EBCLRZ2YTA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.007153356 (225h26m30.558623827s) [noise=true , address=89.149.201.147:4009  , piece_id=OUUHVFVJRLMWU6MPENCT6GDGVV7JNWSKGEGMNXJBH4MQBVJFMPKQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.134864039 (225h26m30.686334491s) [noise=true , address=185.167.204.206:4045 , piece_id=Z6MM74QOT75EG4DOZEY3UFK6EWI5Z4ZLFATHCS6GNVJPROBQFISQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.305662020 (225h26m30.857132481s) [noise=true , address=185.167.204.206:4047 , piece_id=VHMEXXIXEHUVPELR7T24LQK2KWGV62BVM2HANBGBWOZPDTU2B6ZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.422165473 (225h26m30.973635934s) [noise=true , address=185.167.204.206:4057 , piece_id=52GMFUDKI4ZPQTSFEPLT6LCJCBGNI6XRXA5PMFIZCBUQZFTQOSZA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.632759982 (225h26m31.184230433s) [noise=true , address=185.167.204.205:4016 , piece_id=MHOFTLZ5RVHUY3YCTVPHWEGC737AB5YZN32XKUPUAQIGVZEZPLYA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.889540237 (225h26m31.441010698s) [noise=true , address=185.167.204.206:4044 , piece_id=4RORV6AMLX5VKPNTNJ4JRJNXNN73W3ISNIPP3E7ZXDQE5DIXBLGQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.997715453 (225h26m31.549185914s) [noise=true , address=185.167.204.205:4024 , piece_id=AJZPVQ4K7Z5L2URZMYF35G4FDBWYMOEC6OQAKTGYJOG4262IWIQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.520363487 (225h26m32.071833948s) [noise=true , address=185.167.204.206:4062 , piece_id=WWRYTWVHBYPV34KCOXVB5AX7CXOSSQ6SYZD7JXN4WRRG4DUTQ6QA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.945172088 (225h26m32.496642549s) [noise=true , address=185.167.204.205:4031 , piece_id=34WD55UDLX42Y6FNMYM2NDGLUEN45QZXQUDPPMHKZ37KBYSGARMA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.957641322 (225h26m32.509111783s) [noise=true , address=185.167.204.206:4059 , piece_id=FE6DUGRFYURFONXYADJJCF2H3SIE2DLTBGSRWJWI2T7H6I32HBKA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:34.696744055 (225h26m33.248214516s) [noise=true , address=185.167.204.206:4037 , piece_id=PMTC5I64DKRDHZ3JB7MVAUITEKSBKOFOLE34P43B7P4YX4DRR2RQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:34.785216973 (225h26m33.336687434s) [noise=true , address=185.167.204.205:4007 , piece_id=OXHTASGXIWNEHPW7AXB5AURSVESD3MTP4PTHZDSCP24S4JGWZIZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:31:28.781661120 (225h27m27.333131581s) [noise=true , address=81.171.14.70:4025    , piece_id=5QBQR6NS4QCLIXLL5SAJB4AOVOXPXX5RYOFAA3EMNPU4MDMJ54JQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection; write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection
Nov 18 17:31:28.781759597 (225h27m27.333230068s) [noise=true , address=81.171.14.70:4028    , piece_id=V2TXM5JZD5F3GI76XFCOTDIN77TXYAB6AGXWAWI7D2LVRVJWAEGA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection
Nov 18 17:31:28.782024943 (225h27m27.333495424s) [noise=true , address=81.171.14.70:4036    , piece_id=KHOYSS4HJX3CUEPELJ2F7D65CLHFLPPKNBKGR32FF7BKRXFCI7CQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection; write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection
Nov 18 17:31:28.782044410 (225h27m27.333514871s) [noise=true , address=81.171.14.70:4035    , piece_id=BFRV4LT3NCMILNJX4NY2VMIDQKMT4J6KIU64X4SNMVR34XGPSSGA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:31:28.782239802 (225h27m27.333710263s) [noise=true , address=81.171.14.70:4032    , piece_id=SLAQKVHSNAWOEW64XG5NOSXUTG2H7ZIEHIGF5VX7NACNHFLZWLUA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection
Nov 18 17:31:28.782697874 (225h27m27.334168335s) [noise=true , address=81.171.14.70:4031    , piece_id=P25ANJAG4YOYWTA7RQY65YU6PD6JOQ4UL6EZLDAFANGPCF26UXVA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:31:28.782898847 (225h27m27.334369308s) [noise=true , address=81.171.14.70:4040    , piece_id=427SCOPKAE4EYTSZRAK2MEDRH37FXFVU7QNIXOAADFXBABJM5P2Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection; write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection
Nov 18 17:31:28.783023484 (225h27m27.334493946s) [noise=true , address=81.171.14.70:4043    , piece_id=AKOD5NQATSK5F4RE4RYDPIKKUWXOTH2UYABRCIAPINPNQARIMZQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 188.166.225.170:57304->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783231400 (225h27m27.334701861s) [noise=true , address=81.171.14.70:4044    , piece_id=HE7KXV4Y4WDCPYMWURV42GSQF25ACIVXQDUEWXFZLPG3BRQR4HGQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:36730->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783444155 (225h27m27.334914616s) [noise=true , address=81.171.14.70:4047    , piece_id=355WXUD54HTBACHFUIJLLPG7J3HDFKIXK67XD75ZOUH4QPYGTLQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:45804->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783549546 (225h27m27.335020017s) [noise=true , address=81.171.14.70:4027    , piece_id=EJFXIFJVWRIBQHBKOX3TQU3Y7V2TRQTNAE3UHXZ5L6AGW5FLXFZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:59456->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783604971 (225h27m27.335075432s) [seg_pos={0 0}, upload=198546]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Nov 18 17:31:28.951912248 (225h27m27.503382719s) [upload=198546]: Done uploading segments...
Nov 18 17:31:28.951956402 (225h27m27.503426863s) [upload=198546]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.79799382s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X..X...]
duration:
23.279699534s
trace:
https://jaeger.dev.storj.io/trace/51a555b4d737a62f
FAIL (2025-11-18 17:33:35 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
rror group managing segments...
Nov 18 17:30:31.318695700 (225h26m29.870166161s) [noise=true , address=185.167.204.206:4065 , piece_id=OXQDGJBY7DX7OIPFSNV44WEBATH4IMPDH5G5ACM5HUICBKUJVX3Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.440603995 (225h26m29.992074446s) [noise=true , address=185.167.204.205:4003 , piece_id=S6UJTQ35ESOEYBFQYDO3HRDMWV2BQYW3I6KJLH7TBOHNXJW2HZ4A, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.478224401 (225h26m30.029694862s) [noise=true , address=185.167.204.205:4027 , piece_id=C5UQ3RIEW6TTUU33EYOJQJ5IWCGHJNQJ4VJFEPP3TVKXSQV3DA2Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.493526009 (225h26m30.04499646s) [noise=true , address=185.167.204.205:4028 , piece_id=R63PZOV3I5IU4E2NAWZWINZRO7PFMNGAC2Y5ET6XZ6QKC6QLZTSQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.979142178 (225h26m30.530612639s) [noise=true , address=89.149.201.147:4012  , piece_id=V75Q2AOVYTHVE2LIVM2RY2YEVQTWDL7YB2MOIK5Z43EBCLRZ2YTA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.007153356 (225h26m30.558623827s) [noise=true , address=89.149.201.147:4009  , piece_id=OUUHVFVJRLMWU6MPENCT6GDGVV7JNWSKGEGMNXJBH4MQBVJFMPKQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.134864039 (225h26m30.686334491s) [noise=true , address=185.167.204.206:4045 , piece_id=Z6MM74QOT75EG4DOZEY3UFK6EWI5Z4ZLFATHCS6GNVJPROBQFISQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.305662020 (225h26m30.857132481s) [noise=true , address=185.167.204.206:4047 , piece_id=VHMEXXIXEHUVPELR7T24LQK2KWGV62BVM2HANBGBWOZPDTU2B6ZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.422165473 (225h26m30.973635934s) [noise=true , address=185.167.204.206:4057 , piece_id=52GMFUDKI4ZPQTSFEPLT6LCJCBGNI6XRXA5PMFIZCBUQZFTQOSZA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.632759982 (225h26m31.184230433s) [noise=true , address=185.167.204.205:4016 , piece_id=MHOFTLZ5RVHUY3YCTVPHWEGC737AB5YZN32XKUPUAQIGVZEZPLYA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.889540237 (225h26m31.441010698s) [noise=true , address=185.167.204.206:4044 , piece_id=4RORV6AMLX5VKPNTNJ4JRJNXNN73W3ISNIPP3E7ZXDQE5DIXBLGQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.997715453 (225h26m31.549185914s) [noise=true , address=185.167.204.205:4024 , piece_id=AJZPVQ4K7Z5L2URZMYF35G4FDBWYMOEC6OQAKTGYJOG4262IWIQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.520363487 (225h26m32.071833948s) [noise=true , address=185.167.204.206:4062 , piece_id=WWRYTWVHBYPV34KCOXVB5AX7CXOSSQ6SYZD7JXN4WRRG4DUTQ6QA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.945172088 (225h26m32.496642549s) [noise=true , address=185.167.204.205:4031 , piece_id=34WD55UDLX42Y6FNMYM2NDGLUEN45QZXQUDPPMHKZ37KBYSGARMA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.957641322 (225h26m32.509111783s) [noise=true , address=185.167.204.206:4059 , piece_id=FE6DUGRFYURFONXYADJJCF2H3SIE2DLTBGSRWJWI2T7H6I32HBKA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:34.696744055 (225h26m33.248214516s) [noise=true , address=185.167.204.206:4037 , piece_id=PMTC5I64DKRDHZ3JB7MVAUITEKSBKOFOLE34P43B7P4YX4DRR2RQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:34.785216973 (225h26m33.336687434s) [noise=true , address=185.167.204.205:4007 , piece_id=OXHTASGXIWNEHPW7AXB5AURSVESD3MTP4PTHZDSCP24S4JGWZIZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:31:28.781661120 (225h27m27.333131581s) [noise=true , address=81.171.14.70:4025    , piece_id=5QBQR6NS4QCLIXLL5SAJB4AOVOXPXX5RYOFAA3EMNPU4MDMJ54JQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection; write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection
Nov 18 17:31:28.781759597 (225h27m27.333230068s) [noise=true , address=81.171.14.70:4028    , piece_id=V2TXM5JZD5F3GI76XFCOTDIN77TXYAB6AGXWAWI7D2LVRVJWAEGA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection
Nov 18 17:31:28.782024943 (225h27m27.333495424s) [noise=true , address=81.171.14.70:4036    , piece_id=KHOYSS4HJX3CUEPELJ2F7D65CLHFLPPKNBKGR32FF7BKRXFCI7CQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection; write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection
Nov 18 17:31:28.782044410 (225h27m27.333514871s) [noise=true , address=81.171.14.70:4035    , piece_id=BFRV4LT3NCMILNJX4NY2VMIDQKMT4J6KIU64X4SNMVR34XGPSSGA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:31:28.782239802 (225h27m27.333710263s) [noise=true , address=81.171.14.70:4032    , piece_id=SLAQKVHSNAWOEW64XG5NOSXUTG2H7ZIEHIGF5VX7NACNHFLZWLUA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection
Nov 18 17:31:28.782697874 (225h27m27.334168335s) [noise=true , address=81.171.14.70:4031    , piece_id=P25ANJAG4YOYWTA7RQY65YU6PD6JOQ4UL6EZLDAFANGPCF26UXVA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:31:28.782898847 (225h27m27.334369308s) [noise=true , address=81.171.14.70:4040    , piece_id=427SCOPKAE4EYTSZRAK2MEDRH37FXFVU7QNIXOAADFXBABJM5P2Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection; write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection
Nov 18 17:31:28.783023484 (225h27m27.334493946s) [noise=true , address=81.171.14.70:4043    , piece_id=AKOD5NQATSK5F4RE4RYDPIKKUWXOTH2UYABRCIAPINPNQARIMZQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 188.166.225.170:57304->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783231400 (225h27m27.334701861s) [noise=true , address=81.171.14.70:4044    , piece_id=HE7KXV4Y4WDCPYMWURV42GSQF25ACIVXQDUEWXFZLPG3BRQR4HGQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:36730->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783444155 (225h27m27.334914616s) [noise=true , address=81.171.14.70:4047    , piece_id=355WXUD54HTBACHFUIJLLPG7J3HDFKIXK67XD75ZOUH4QPYGTLQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:45804->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783549546 (225h27m27.335020017s) [noise=true , address=81.171.14.70:4027    , piece_id=EJFXIFJVWRIBQHBKOX3TQU3Y7V2TRQTNAE3UHXZ5L6AGW5FLXFZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:59456->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783604971 (225h27m27.335075432s) [seg_pos={0 0}, upload=198546]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Nov 18 17:31:28.951912248 (225h27m27.503382719s) [upload=198546]: Done uploading segments...
Nov 18 17:31:28.951956402 (225h27m27.503426863s) [upload=198546]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 23.279728098s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [......................................................X..X..]
duration:
5.860460929s
trace:
https://jaeger.dev.storj.io/trace/51a555b4d737a62f
FAIL (2025-11-18 17:32:04 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
rror group managing segments...
Nov 18 17:30:31.318695700 (225h26m29.870166161s) [noise=true , address=185.167.204.206:4065 , piece_id=OXQDGJBY7DX7OIPFSNV44WEBATH4IMPDH5G5ACM5HUICBKUJVX3Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.440603995 (225h26m29.992074446s) [noise=true , address=185.167.204.205:4003 , piece_id=S6UJTQ35ESOEYBFQYDO3HRDMWV2BQYW3I6KJLH7TBOHNXJW2HZ4A, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.478224401 (225h26m30.029694862s) [noise=true , address=185.167.204.205:4027 , piece_id=C5UQ3RIEW6TTUU33EYOJQJ5IWCGHJNQJ4VJFEPP3TVKXSQV3DA2Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.493526009 (225h26m30.04499646s) [noise=true , address=185.167.204.205:4028 , piece_id=R63PZOV3I5IU4E2NAWZWINZRO7PFMNGAC2Y5ET6XZ6QKC6QLZTSQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.979142178 (225h26m30.530612639s) [noise=true , address=89.149.201.147:4012  , piece_id=V75Q2AOVYTHVE2LIVM2RY2YEVQTWDL7YB2MOIK5Z43EBCLRZ2YTA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.007153356 (225h26m30.558623827s) [noise=true , address=89.149.201.147:4009  , piece_id=OUUHVFVJRLMWU6MPENCT6GDGVV7JNWSKGEGMNXJBH4MQBVJFMPKQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.134864039 (225h26m30.686334491s) [noise=true , address=185.167.204.206:4045 , piece_id=Z6MM74QOT75EG4DOZEY3UFK6EWI5Z4ZLFATHCS6GNVJPROBQFISQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.305662020 (225h26m30.857132481s) [noise=true , address=185.167.204.206:4047 , piece_id=VHMEXXIXEHUVPELR7T24LQK2KWGV62BVM2HANBGBWOZPDTU2B6ZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.422165473 (225h26m30.973635934s) [noise=true , address=185.167.204.206:4057 , piece_id=52GMFUDKI4ZPQTSFEPLT6LCJCBGNI6XRXA5PMFIZCBUQZFTQOSZA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.632759982 (225h26m31.184230433s) [noise=true , address=185.167.204.205:4016 , piece_id=MHOFTLZ5RVHUY3YCTVPHWEGC737AB5YZN32XKUPUAQIGVZEZPLYA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.889540237 (225h26m31.441010698s) [noise=true , address=185.167.204.206:4044 , piece_id=4RORV6AMLX5VKPNTNJ4JRJNXNN73W3ISNIPP3E7ZXDQE5DIXBLGQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.997715453 (225h26m31.549185914s) [noise=true , address=185.167.204.205:4024 , piece_id=AJZPVQ4K7Z5L2URZMYF35G4FDBWYMOEC6OQAKTGYJOG4262IWIQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.520363487 (225h26m32.071833948s) [noise=true , address=185.167.204.206:4062 , piece_id=WWRYTWVHBYPV34KCOXVB5AX7CXOSSQ6SYZD7JXN4WRRG4DUTQ6QA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.945172088 (225h26m32.496642549s) [noise=true , address=185.167.204.205:4031 , piece_id=34WD55UDLX42Y6FNMYM2NDGLUEN45QZXQUDPPMHKZ37KBYSGARMA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.957641322 (225h26m32.509111783s) [noise=true , address=185.167.204.206:4059 , piece_id=FE6DUGRFYURFONXYADJJCF2H3SIE2DLTBGSRWJWI2T7H6I32HBKA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:34.696744055 (225h26m33.248214516s) [noise=true , address=185.167.204.206:4037 , piece_id=PMTC5I64DKRDHZ3JB7MVAUITEKSBKOFOLE34P43B7P4YX4DRR2RQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:34.785216973 (225h26m33.336687434s) [noise=true , address=185.167.204.205:4007 , piece_id=OXHTASGXIWNEHPW7AXB5AURSVESD3MTP4PTHZDSCP24S4JGWZIZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:31:28.781661120 (225h27m27.333131581s) [noise=true , address=81.171.14.70:4025    , piece_id=5QBQR6NS4QCLIXLL5SAJB4AOVOXPXX5RYOFAA3EMNPU4MDMJ54JQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection; write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection
Nov 18 17:31:28.781759597 (225h27m27.333230068s) [noise=true , address=81.171.14.70:4028    , piece_id=V2TXM5JZD5F3GI76XFCOTDIN77TXYAB6AGXWAWI7D2LVRVJWAEGA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection
Nov 18 17:31:28.782024943 (225h27m27.333495424s) [noise=true , address=81.171.14.70:4036    , piece_id=KHOYSS4HJX3CUEPELJ2F7D65CLHFLPPKNBKGR32FF7BKRXFCI7CQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection; write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection
Nov 18 17:31:28.782044410 (225h27m27.333514871s) [noise=true , address=81.171.14.70:4035    , piece_id=BFRV4LT3NCMILNJX4NY2VMIDQKMT4J6KIU64X4SNMVR34XGPSSGA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:31:28.782239802 (225h27m27.333710263s) [noise=true , address=81.171.14.70:4032    , piece_id=SLAQKVHSNAWOEW64XG5NOSXUTG2H7ZIEHIGF5VX7NACNHFLZWLUA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection
Nov 18 17:31:28.782697874 (225h27m27.334168335s) [noise=true , address=81.171.14.70:4031    , piece_id=P25ANJAG4YOYWTA7RQY65YU6PD6JOQ4UL6EZLDAFANGPCF26UXVA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:31:28.782898847 (225h27m27.334369308s) [noise=true , address=81.171.14.70:4040    , piece_id=427SCOPKAE4EYTSZRAK2MEDRH37FXFVU7QNIXOAADFXBABJM5P2Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection; write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection
Nov 18 17:31:28.783023484 (225h27m27.334493946s) [noise=true , address=81.171.14.70:4043    , piece_id=AKOD5NQATSK5F4RE4RYDPIKKUWXOTH2UYABRCIAPINPNQARIMZQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 188.166.225.170:57304->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783231400 (225h27m27.334701861s) [noise=true , address=81.171.14.70:4044    , piece_id=HE7KXV4Y4WDCPYMWURV42GSQF25ACIVXQDUEWXFZLPG3BRQR4HGQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:36730->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783444155 (225h27m27.334914616s) [noise=true , address=81.171.14.70:4047    , piece_id=355WXUD54HTBACHFUIJLLPG7J3HDFKIXK67XD75ZOUH4QPYGTLQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:45804->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783549546 (225h27m27.335020017s) [noise=true , address=81.171.14.70:4027    , piece_id=EJFXIFJVWRIBQHBKOX3TQU3Y7V2TRQTNAE3UHXZ5L6AGW5FLXFZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:59456->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783604971 (225h27m27.335075432s) [seg_pos={0 0}, upload=198546]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Nov 18 17:31:28.951912248 (225h27m27.503382719s) [upload=198546]: Done uploading segments...
Nov 18 17:31:28.951956402 (225h27m27.503426863s) [upload=198546]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.860515894s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X..X.]
duration:
5.682719128s
trace:
https://jaeger.dev.storj.io/trace/51a555b4d737a62f
FAIL (2025-11-18 17:31:34 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
rror group managing segments...
Nov 18 17:30:31.318695700 (225h26m29.870166161s) [noise=true , address=185.167.204.206:4065 , piece_id=OXQDGJBY7DX7OIPFSNV44WEBATH4IMPDH5G5ACM5HUICBKUJVX3Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.440603995 (225h26m29.992074446s) [noise=true , address=185.167.204.205:4003 , piece_id=S6UJTQ35ESOEYBFQYDO3HRDMWV2BQYW3I6KJLH7TBOHNXJW2HZ4A, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.478224401 (225h26m30.029694862s) [noise=true , address=185.167.204.205:4027 , piece_id=C5UQ3RIEW6TTUU33EYOJQJ5IWCGHJNQJ4VJFEPP3TVKXSQV3DA2Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.493526009 (225h26m30.04499646s) [noise=true , address=185.167.204.205:4028 , piece_id=R63PZOV3I5IU4E2NAWZWINZRO7PFMNGAC2Y5ET6XZ6QKC6QLZTSQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.979142178 (225h26m30.530612639s) [noise=true , address=89.149.201.147:4012  , piece_id=V75Q2AOVYTHVE2LIVM2RY2YEVQTWDL7YB2MOIK5Z43EBCLRZ2YTA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.007153356 (225h26m30.558623827s) [noise=true , address=89.149.201.147:4009  , piece_id=OUUHVFVJRLMWU6MPENCT6GDGVV7JNWSKGEGMNXJBH4MQBVJFMPKQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.134864039 (225h26m30.686334491s) [noise=true , address=185.167.204.206:4045 , piece_id=Z6MM74QOT75EG4DOZEY3UFK6EWI5Z4ZLFATHCS6GNVJPROBQFISQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.305662020 (225h26m30.857132481s) [noise=true , address=185.167.204.206:4047 , piece_id=VHMEXXIXEHUVPELR7T24LQK2KWGV62BVM2HANBGBWOZPDTU2B6ZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.422165473 (225h26m30.973635934s) [noise=true , address=185.167.204.206:4057 , piece_id=52GMFUDKI4ZPQTSFEPLT6LCJCBGNI6XRXA5PMFIZCBUQZFTQOSZA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.632759982 (225h26m31.184230433s) [noise=true , address=185.167.204.205:4016 , piece_id=MHOFTLZ5RVHUY3YCTVPHWEGC737AB5YZN32XKUPUAQIGVZEZPLYA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.889540237 (225h26m31.441010698s) [noise=true , address=185.167.204.206:4044 , piece_id=4RORV6AMLX5VKPNTNJ4JRJNXNN73W3ISNIPP3E7ZXDQE5DIXBLGQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.997715453 (225h26m31.549185914s) [noise=true , address=185.167.204.205:4024 , piece_id=AJZPVQ4K7Z5L2URZMYF35G4FDBWYMOEC6OQAKTGYJOG4262IWIQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.520363487 (225h26m32.071833948s) [noise=true , address=185.167.204.206:4062 , piece_id=WWRYTWVHBYPV34KCOXVB5AX7CXOSSQ6SYZD7JXN4WRRG4DUTQ6QA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.945172088 (225h26m32.496642549s) [noise=true , address=185.167.204.205:4031 , piece_id=34WD55UDLX42Y6FNMYM2NDGLUEN45QZXQUDPPMHKZ37KBYSGARMA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.957641322 (225h26m32.509111783s) [noise=true , address=185.167.204.206:4059 , piece_id=FE6DUGRFYURFONXYADJJCF2H3SIE2DLTBGSRWJWI2T7H6I32HBKA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:34.696744055 (225h26m33.248214516s) [noise=true , address=185.167.204.206:4037 , piece_id=PMTC5I64DKRDHZ3JB7MVAUITEKSBKOFOLE34P43B7P4YX4DRR2RQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:34.785216973 (225h26m33.336687434s) [noise=true , address=185.167.204.205:4007 , piece_id=OXHTASGXIWNEHPW7AXB5AURSVESD3MTP4PTHZDSCP24S4JGWZIZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:31:28.781661120 (225h27m27.333131581s) [noise=true , address=81.171.14.70:4025    , piece_id=5QBQR6NS4QCLIXLL5SAJB4AOVOXPXX5RYOFAA3EMNPU4MDMJ54JQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection; write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection
Nov 18 17:31:28.781759597 (225h27m27.333230068s) [noise=true , address=81.171.14.70:4028    , piece_id=V2TXM5JZD5F3GI76XFCOTDIN77TXYAB6AGXWAWI7D2LVRVJWAEGA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection
Nov 18 17:31:28.782024943 (225h27m27.333495424s) [noise=true , address=81.171.14.70:4036    , piece_id=KHOYSS4HJX3CUEPELJ2F7D65CLHFLPPKNBKGR32FF7BKRXFCI7CQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection; write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection
Nov 18 17:31:28.782044410 (225h27m27.333514871s) [noise=true , address=81.171.14.70:4035    , piece_id=BFRV4LT3NCMILNJX4NY2VMIDQKMT4J6KIU64X4SNMVR34XGPSSGA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:31:28.782239802 (225h27m27.333710263s) [noise=true , address=81.171.14.70:4032    , piece_id=SLAQKVHSNAWOEW64XG5NOSXUTG2H7ZIEHIGF5VX7NACNHFLZWLUA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection
Nov 18 17:31:28.782697874 (225h27m27.334168335s) [noise=true , address=81.171.14.70:4031    , piece_id=P25ANJAG4YOYWTA7RQY65YU6PD6JOQ4UL6EZLDAFANGPCF26UXVA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:31:28.782898847 (225h27m27.334369308s) [noise=true , address=81.171.14.70:4040    , piece_id=427SCOPKAE4EYTSZRAK2MEDRH37FXFVU7QNIXOAADFXBABJM5P2Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection; write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection
Nov 18 17:31:28.783023484 (225h27m27.334493946s) [noise=true , address=81.171.14.70:4043    , piece_id=AKOD5NQATSK5F4RE4RYDPIKKUWXOTH2UYABRCIAPINPNQARIMZQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 188.166.225.170:57304->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783231400 (225h27m27.334701861s) [noise=true , address=81.171.14.70:4044    , piece_id=HE7KXV4Y4WDCPYMWURV42GSQF25ACIVXQDUEWXFZLPG3BRQR4HGQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:36730->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783444155 (225h27m27.334914616s) [noise=true , address=81.171.14.70:4047    , piece_id=355WXUD54HTBACHFUIJLLPG7J3HDFKIXK67XD75ZOUH4QPYGTLQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:45804->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783549546 (225h27m27.335020017s) [noise=true , address=81.171.14.70:4027    , piece_id=EJFXIFJVWRIBQHBKOX3TQU3Y7V2TRQTNAE3UHXZ5L6AGW5FLXFZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:59456->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783604971 (225h27m27.335075432s) [seg_pos={0 0}, upload=198546]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Nov 18 17:31:28.951912248 (225h27m27.503382719s) [upload=198546]: Done uploading segments...
Nov 18 17:31:28.951956402 (225h27m27.503426863s) [upload=198546]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.682740709s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [........................................................X..X]
duration:
1m0.172839933s
trace:
https://jaeger.dev.storj.io/trace/51a555b4d737a62f
FAIL (2025-11-18 17:31:28 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
rror group managing segments...
Nov 18 17:30:31.318695700 (225h26m29.870166161s) [noise=true , address=185.167.204.206:4065 , piece_id=OXQDGJBY7DX7OIPFSNV44WEBATH4IMPDH5G5ACM5HUICBKUJVX3Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.440603995 (225h26m29.992074446s) [noise=true , address=185.167.204.205:4003 , piece_id=S6UJTQ35ESOEYBFQYDO3HRDMWV2BQYW3I6KJLH7TBOHNXJW2HZ4A, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.478224401 (225h26m30.029694862s) [noise=true , address=185.167.204.205:4027 , piece_id=C5UQ3RIEW6TTUU33EYOJQJ5IWCGHJNQJ4VJFEPP3TVKXSQV3DA2Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.493526009 (225h26m30.04499646s) [noise=true , address=185.167.204.205:4028 , piece_id=R63PZOV3I5IU4E2NAWZWINZRO7PFMNGAC2Y5ET6XZ6QKC6QLZTSQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:31.979142178 (225h26m30.530612639s) [noise=true , address=89.149.201.147:4012  , piece_id=V75Q2AOVYTHVE2LIVM2RY2YEVQTWDL7YB2MOIK5Z43EBCLRZ2YTA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.007153356 (225h26m30.558623827s) [noise=true , address=89.149.201.147:4009  , piece_id=OUUHVFVJRLMWU6MPENCT6GDGVV7JNWSKGEGMNXJBH4MQBVJFMPKQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.134864039 (225h26m30.686334491s) [noise=true , address=185.167.204.206:4045 , piece_id=Z6MM74QOT75EG4DOZEY3UFK6EWI5Z4ZLFATHCS6GNVJPROBQFISQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.305662020 (225h26m30.857132481s) [noise=true , address=185.167.204.206:4047 , piece_id=VHMEXXIXEHUVPELR7T24LQK2KWGV62BVM2HANBGBWOZPDTU2B6ZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.422165473 (225h26m30.973635934s) [noise=true , address=185.167.204.206:4057 , piece_id=52GMFUDKI4ZPQTSFEPLT6LCJCBGNI6XRXA5PMFIZCBUQZFTQOSZA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.632759982 (225h26m31.184230433s) [noise=true , address=185.167.204.205:4016 , piece_id=MHOFTLZ5RVHUY3YCTVPHWEGC737AB5YZN32XKUPUAQIGVZEZPLYA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.889540237 (225h26m31.441010698s) [noise=true , address=185.167.204.206:4044 , piece_id=4RORV6AMLX5VKPNTNJ4JRJNXNN73W3ISNIPP3E7ZXDQE5DIXBLGQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:32.997715453 (225h26m31.549185914s) [noise=true , address=185.167.204.205:4024 , piece_id=AJZPVQ4K7Z5L2URZMYF35G4FDBWYMOEC6OQAKTGYJOG4262IWIQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.520363487 (225h26m32.071833948s) [noise=true , address=185.167.204.206:4062 , piece_id=WWRYTWVHBYPV34KCOXVB5AX7CXOSSQ6SYZD7JXN4WRRG4DUTQ6QA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.945172088 (225h26m32.496642549s) [noise=true , address=185.167.204.205:4031 , piece_id=34WD55UDLX42Y6FNMYM2NDGLUEN45QZXQUDPPMHKZ37KBYSGARMA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:33.957641322 (225h26m32.509111783s) [noise=true , address=185.167.204.206:4059 , piece_id=FE6DUGRFYURFONXYADJJCF2H3SIE2DLTBGSRWJWI2T7H6I32HBKA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:34.696744055 (225h26m33.248214516s) [noise=true , address=185.167.204.206:4037 , piece_id=PMTC5I64DKRDHZ3JB7MVAUITEKSBKOFOLE34P43B7P4YX4DRR2RQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:30:34.785216973 (225h26m33.336687434s) [noise=true , address=185.167.204.205:4007 , piece_id=OXHTASGXIWNEHPW7AXB5AURSVESD3MTP4PTHZDSCP24S4JGWZIZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: <nil>
Nov 18 17:31:28.781661120 (225h27m27.333131581s) [noise=true , address=81.171.14.70:4025    , piece_id=5QBQR6NS4QCLIXLL5SAJB4AOVOXPXX5RYOFAA3EMNPU4MDMJ54JQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection; write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56848->81.171.14.70:4025: use of closed network connection
Nov 18 17:31:28.781759597 (225h27m27.333230068s) [noise=true , address=81.171.14.70:4028    , piece_id=V2TXM5JZD5F3GI76XFCOTDIN77TXYAB6AGXWAWI7D2LVRVJWAEGA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection; write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36482->81.171.14.70:4028: use of closed network connection
Nov 18 17:31:28.782024943 (225h27m27.333495424s) [noise=true , address=81.171.14.70:4036    , piece_id=KHOYSS4HJX3CUEPELJ2F7D65CLHFLPPKNBKGR32FF7BKRXFCI7CQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection; write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41552->81.171.14.70:4036: use of closed network connection
Nov 18 17:31:28.782044410 (225h27m27.333514871s) [noise=true , address=81.171.14.70:4035    , piece_id=BFRV4LT3NCMILNJX4NY2VMIDQKMT4J6KIU64X4SNMVR34XGPSSGA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:31:28.782239802 (225h27m27.333710263s) [noise=true , address=81.171.14.70:4032    , piece_id=SLAQKVHSNAWOEW64XG5NOSXUTG2H7ZIEHIGF5VX7NACNHFLZWLUA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection; write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56548->81.171.14.70:4032: use of closed network connection
Nov 18 17:31:28.782697874 (225h27m27.334168335s) [noise=true , address=81.171.14.70:4031    , piece_id=P25ANJAG4YOYWTA7RQY65YU6PD6JOQ4UL6EZLDAFANGPCF26UXVA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:31:28.782898847 (225h27m27.334369308s) [noise=true , address=81.171.14.70:4040    , piece_id=427SCOPKAE4EYTSZRAK2MEDRH37FXFVU7QNIXOAADFXBABJM5P2Q, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection; write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55530->81.171.14.70:4040: use of closed network connection
Nov 18 17:31:28.783023484 (225h27m27.334493946s) [noise=true , address=81.171.14.70:4043    , piece_id=AKOD5NQATSK5F4RE4RYDPIKKUWXOTH2UYABRCIAPINPNQARIMZQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 188.166.225.170:57304->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783231400 (225h27m27.334701861s) [noise=true , address=81.171.14.70:4044    , piece_id=HE7KXV4Y4WDCPYMWURV42GSQF25ACIVXQDUEWXFZLPG3BRQR4HGQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: read tcp 188.166.225.170:36730->81.171.14.70:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783444155 (225h27m27.334914616s) [noise=true , address=81.171.14.70:4047    , piece_id=355WXUD54HTBACHFUIJLLPG7J3HDFKIXK67XD75ZOUH4QPYGTLQA, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:45804->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783549546 (225h27m27.335020017s) [noise=true , address=81.171.14.70:4027    , piece_id=EJFXIFJVWRIBQHBKOX3TQU3Y7V2TRQTNAE3UHXZ5L6AGW5FLXFZQ, seg_pos={0 0}, upload=198546]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 188.166.225.170:59456->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:31:28.783604971 (225h27m27.335075432s) [seg_pos={0 0}, upload=198546]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Nov 18 17:31:28.951912248 (225h27m27.503382719s) [upload=198546]: Done uploading segments...
Nov 18 17:31:28.951956402 (225h27m27.503426863s) [upload=198546]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 1m0.172855091s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
5.337414055s
trace:
https://jaeger.dev.storj.io/trace/6846782f31badfad
FAIL (2025-11-18 17:29:27 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
.147:4022  , piece_id=FOY3JLRUJLRK6O4P3C6AODB6BPKPQVS3FELWDLFABQZXQQAEAOTQ, seg_pos={0 0}, upload=198510]: Uploading piece...
Nov 18 17:27:54.918502382 (225h23m53.469972843s) [noise=true , address=89.149.201.147:4015  , piece_id=TCXDQOAOLSWRC3XDJOVZ5ZDCVYQVYHLHPPPJCQJE3533D6NF3ZCQ, seg_pos={0 0}, upload=198510]: Uploading piece...
Nov 18 17:27:54.918944945 (225h23m53.470415406s) [noise=true , address=89.149.201.147:4011  , piece_id=L47JVOM6VAZBKSMDYQ23SOPKFHYJXWVAF4NYPD35UMDYXS5LDE7A, seg_pos={0 0}, upload=198510]: Uploading piece...
Nov 18 17:27:54.919351870 (225h23m53.470822331s) [noise=true , address=81.171.14.70:4040    , piece_id=5XM6H5PHTYLS3C3V5724Y4P2YGZGNT267KOAIR434IOUY3LOCTWQ, seg_pos={0 0}, upload=198510]: Uploading piece...
Nov 18 17:27:56.205024971 (225h23m54.756495432s) [upload=198510]: Next returned nil segment
Nov 18 17:27:56.205036592 (225h23m54.756507053s) [upload=198510]: Waiting for error group managing segments...
Nov 18 17:27:56.810747814 (225h23m55.362218275s) [noise=true , address=185.167.204.205:4034 , piece_id=EGQXLFTJRJVKYE4NF6N5MZL2OG6222JSYYK5DX5MNBHQF32C4W7A, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:56.827677882 (225h23m55.379148343s) [noise=true , address=185.167.204.206:4060 , piece_id=SW5OY5YFJ3VIZEEVKVRX4A2NJS4ZX4JMS7VS6O7TT3VRUCQCBRBA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:56.850030165 (225h23m55.401500626s) [noise=true , address=185.167.204.206:4041 , piece_id=N7TKXSNP4MXS6B6GQ2DJK6TWY7X3N3UEPFMHGD6S6HHP7IKPQFZQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.343059069 (225h23m55.89452952s) [noise=true , address=89.149.201.147:4022  , piece_id=FOY3JLRUJLRK6O4P3C6AODB6BPKPQVS3FELWDLFABQZXQQAEAOTQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.374394879 (225h23m55.92586533s) [noise=true , address=89.149.201.147:4011  , piece_id=L47JVOM6VAZBKSMDYQ23SOPKFHYJXWVAF4NYPD35UMDYXS5LDE7A, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.377007934 (225h23m55.928478395s) [noise=true , address=89.149.201.147:4005  , piece_id=HRH5T6TFGMGWJD3ZXZKKB47DLPX2NDUFTZ6PLRCBSW6JWIMOFY4A, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.403439314 (225h23m55.954909765s) [noise=true , address=89.149.201.147:4009  , piece_id=ZS767QXDTTFML6CL6UM2A2QLHCAGOJRBQB73HE7RVPY6HJCL2KVA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.427817104 (225h23m55.979287555s) [noise=true , address=89.149.201.147:4021  , piece_id=3EZ36VL7JG4ZLCMB74CI3NYONADYQOLLUQUMPLX2Z6OG6KQKKFEA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.629356120 (225h23m56.180826581s) [noise=true , address=185.167.204.205:4021 , piece_id=7RXLEAKF6BMBAOBHE7K3HTK7HTVR5WGI4Y6XNCEPJKUXUKZEGXGA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.863697377 (225h23m56.415167828s) [noise=true , address=185.167.204.206:4047 , piece_id=25GKJRMEID55XBUOT4YHBH2NNQWHHGBLUAQ6QKRUDGZHMGAQTKJA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.921360007 (225h23m56.472830468s) [noise=true , address=89.149.201.147:4020  , piece_id=YIWOUCYK4ENQOBCXXLG3GTHOV52AQ2PHGM72SNQKMYW4UJ44LV5Q, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.968503207 (225h23m56.519973668s) [noise=true , address=89.149.201.147:4015  , piece_id=TCXDQOAOLSWRC3XDJOVZ5ZDCVYQVYHLHPPPJCQJE3533D6NF3ZCQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.105114990 (225h23m56.656585451s) [noise=true , address=185.167.204.205:4005 , piece_id=3KZRXOMXLDMVWNZWEURV32CVXDRN3Z7FGZWYE4PSOZH2MGLDREEA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.142605799 (225h23m56.69407626s) [noise=true , address=185.167.204.205:4019 , piece_id=ZCPCSEI7J7VPIT7LDH2T7NNNITBX2633LEHPQDZRUA2Z7PW5QPTA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.328022384 (225h23m56.879492875s) [noise=true , address=185.167.204.205:4010 , piece_id=KST4NIBRUIXI3YH5U7MU2NOXP3DSU7UG7BKM3JKQLLT5BETOEFGA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.399161546 (225h23m56.950632007s) [noise=true , address=185.167.204.206:4056 , piece_id=ZBEFERR6LVJVZSPICRBOF7HPOPPFFQKKZ5FCPOQMO6RAJYQSGWSQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.880210359 (225h23m57.43168081s) [noise=true , address=185.167.204.205:4032 , piece_id=E3FUKWUYYFDNRWGF755SI46OHPV6SBQE6YY4LZ3TUBPR2HDCO7BQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:28:51.027529862 (225h24m49.579000323s) [noise=true , address=81.171.14.70:4029    , piece_id=22XHKKNZEGV7IPDYPLS4MZVKR3YSWC57RP4L6BIECFWELIKV3YJA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:28:54.268315084 (225h24m52.819785545s) [noise=true , address=81.171.14.70:4039    , piece_id=3QDZDOONZDGMARA6RUM3E4NNINXZ5NZNGCE4XAS4XMS27ZJ3IIMQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:44042->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:44042->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44042->81.171.14.70:4039: use of closed network connection
Nov 18 17:28:54.268392841 (225h24m52.819863302s) [noise=true , address=81.171.14.70:4040    , piece_id=5XM6H5PHTYLS3C3V5724Y4P2YGZGNT267KOAIR434IOUY3LOCTWQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:51704->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.268547236 (225h24m52.820017697s) [noise=true , address=81.171.14.70:4041    , piece_id=XSWFTNAZ7H3F2LOD5KRUIPKT3K4EO5FIF45TEKL3GZRXOZBXCCQA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:32986->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.268586190 (225h24m52.820056651s) [noise=true , address=81.171.14.70:4043    , piece_id=5B73XAI3QMFSIPL22F2N5CZRKWLEJWBVXYNE67AAMXIGUIK54AOA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:28:54.268666282 (225h24m52.820136743s) [noise=true , address=81.171.14.70:4047    , piece_id=4OZEVNAFVNAKPCO2L7ADMV37TWUOI4J65ACZFFHXPNHQWBO45EPQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:52782->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.268733941 (225h24m52.820204402s) [noise=true , address=81.171.14.70:4042    , piece_id=BREL6IRSSIGMBMGXSWESYLAXVQ6TEIK6ERUEYLBF7DSGVN65ATSA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:28:54.268771863 (225h24m52.820242314s) [noise=true , address=81.171.14.70:4035    , piece_id=YRBGBWX3BVF44S7BOLRJZW3OSGC2NJX2EXXFSLOFTEE4XTYQDQLQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: read tcp 188.166.225.170:38228->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.268957618 (225h24m52.820428079s) [noise=true , address=81.171.14.70:4031    , piece_id=OJUZCT4CBKUEKGA6VRXIETJQET7W3X3XD53LTKLVAWDRXNXJ74IQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:28:54.269011339 (225h24m52.82048179s) [noise=true , address=81.171.14.70:4032    , piece_id=FXZ23EUQINKHYVPTVXYUYGPLOJBKIV4Y2ELZJXCQYNVZUEPA6JAQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: read tcp 188.166.225.170:42104->81.171.14.70:4032: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.269157207 (225h24m52.820627678s) [noise=true , address=81.171.14.70:4030    , piece_id=PMMS5MRAROQKF4CM6HJS7GOKVPMC7HA4EJFSXTTJJPKAOCEKOG6A, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: read tcp 188.166.225.170:48622->81.171.14.70:4030: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.269254072 (225h24m52.820724533s) [seg_pos={0 0}, upload=198510]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Nov 18 17:28:54.437452321 (225h24m52.988922782s) [upload=198510]: Done uploading segments...
Nov 18 17:28:54.437491736 (225h24m52.988962197s) [upload=198510]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 5.337446487s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
6.24918504s
trace:
https://jaeger.dev.storj.io/trace/6846782f31badfad
FAIL (2025-11-18 17:29:00 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
.147:4022  , piece_id=FOY3JLRUJLRK6O4P3C6AODB6BPKPQVS3FELWDLFABQZXQQAEAOTQ, seg_pos={0 0}, upload=198510]: Uploading piece...
Nov 18 17:27:54.918502382 (225h23m53.469972843s) [noise=true , address=89.149.201.147:4015  , piece_id=TCXDQOAOLSWRC3XDJOVZ5ZDCVYQVYHLHPPPJCQJE3533D6NF3ZCQ, seg_pos={0 0}, upload=198510]: Uploading piece...
Nov 18 17:27:54.918944945 (225h23m53.470415406s) [noise=true , address=89.149.201.147:4011  , piece_id=L47JVOM6VAZBKSMDYQ23SOPKFHYJXWVAF4NYPD35UMDYXS5LDE7A, seg_pos={0 0}, upload=198510]: Uploading piece...
Nov 18 17:27:54.919351870 (225h23m53.470822331s) [noise=true , address=81.171.14.70:4040    , piece_id=5XM6H5PHTYLS3C3V5724Y4P2YGZGNT267KOAIR434IOUY3LOCTWQ, seg_pos={0 0}, upload=198510]: Uploading piece...
Nov 18 17:27:56.205024971 (225h23m54.756495432s) [upload=198510]: Next returned nil segment
Nov 18 17:27:56.205036592 (225h23m54.756507053s) [upload=198510]: Waiting for error group managing segments...
Nov 18 17:27:56.810747814 (225h23m55.362218275s) [noise=true , address=185.167.204.205:4034 , piece_id=EGQXLFTJRJVKYE4NF6N5MZL2OG6222JSYYK5DX5MNBHQF32C4W7A, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:56.827677882 (225h23m55.379148343s) [noise=true , address=185.167.204.206:4060 , piece_id=SW5OY5YFJ3VIZEEVKVRX4A2NJS4ZX4JMS7VS6O7TT3VRUCQCBRBA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:56.850030165 (225h23m55.401500626s) [noise=true , address=185.167.204.206:4041 , piece_id=N7TKXSNP4MXS6B6GQ2DJK6TWY7X3N3UEPFMHGD6S6HHP7IKPQFZQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.343059069 (225h23m55.89452952s) [noise=true , address=89.149.201.147:4022  , piece_id=FOY3JLRUJLRK6O4P3C6AODB6BPKPQVS3FELWDLFABQZXQQAEAOTQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.374394879 (225h23m55.92586533s) [noise=true , address=89.149.201.147:4011  , piece_id=L47JVOM6VAZBKSMDYQ23SOPKFHYJXWVAF4NYPD35UMDYXS5LDE7A, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.377007934 (225h23m55.928478395s) [noise=true , address=89.149.201.147:4005  , piece_id=HRH5T6TFGMGWJD3ZXZKKB47DLPX2NDUFTZ6PLRCBSW6JWIMOFY4A, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.403439314 (225h23m55.954909765s) [noise=true , address=89.149.201.147:4009  , piece_id=ZS767QXDTTFML6CL6UM2A2QLHCAGOJRBQB73HE7RVPY6HJCL2KVA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.427817104 (225h23m55.979287555s) [noise=true , address=89.149.201.147:4021  , piece_id=3EZ36VL7JG4ZLCMB74CI3NYONADYQOLLUQUMPLX2Z6OG6KQKKFEA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.629356120 (225h23m56.180826581s) [noise=true , address=185.167.204.205:4021 , piece_id=7RXLEAKF6BMBAOBHE7K3HTK7HTVR5WGI4Y6XNCEPJKUXUKZEGXGA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.863697377 (225h23m56.415167828s) [noise=true , address=185.167.204.206:4047 , piece_id=25GKJRMEID55XBUOT4YHBH2NNQWHHGBLUAQ6QKRUDGZHMGAQTKJA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.921360007 (225h23m56.472830468s) [noise=true , address=89.149.201.147:4020  , piece_id=YIWOUCYK4ENQOBCXXLG3GTHOV52AQ2PHGM72SNQKMYW4UJ44LV5Q, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.968503207 (225h23m56.519973668s) [noise=true , address=89.149.201.147:4015  , piece_id=TCXDQOAOLSWRC3XDJOVZ5ZDCVYQVYHLHPPPJCQJE3533D6NF3ZCQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.105114990 (225h23m56.656585451s) [noise=true , address=185.167.204.205:4005 , piece_id=3KZRXOMXLDMVWNZWEURV32CVXDRN3Z7FGZWYE4PSOZH2MGLDREEA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.142605799 (225h23m56.69407626s) [noise=true , address=185.167.204.205:4019 , piece_id=ZCPCSEI7J7VPIT7LDH2T7NNNITBX2633LEHPQDZRUA2Z7PW5QPTA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.328022384 (225h23m56.879492875s) [noise=true , address=185.167.204.205:4010 , piece_id=KST4NIBRUIXI3YH5U7MU2NOXP3DSU7UG7BKM3JKQLLT5BETOEFGA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.399161546 (225h23m56.950632007s) [noise=true , address=185.167.204.206:4056 , piece_id=ZBEFERR6LVJVZSPICRBOF7HPOPPFFQKKZ5FCPOQMO6RAJYQSGWSQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.880210359 (225h23m57.43168081s) [noise=true , address=185.167.204.205:4032 , piece_id=E3FUKWUYYFDNRWGF755SI46OHPV6SBQE6YY4LZ3TUBPR2HDCO7BQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:28:51.027529862 (225h24m49.579000323s) [noise=true , address=81.171.14.70:4029    , piece_id=22XHKKNZEGV7IPDYPLS4MZVKR3YSWC57RP4L6BIECFWELIKV3YJA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:28:54.268315084 (225h24m52.819785545s) [noise=true , address=81.171.14.70:4039    , piece_id=3QDZDOONZDGMARA6RUM3E4NNINXZ5NZNGCE4XAS4XMS27ZJ3IIMQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:44042->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:44042->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44042->81.171.14.70:4039: use of closed network connection
Nov 18 17:28:54.268392841 (225h24m52.819863302s) [noise=true , address=81.171.14.70:4040    , piece_id=5XM6H5PHTYLS3C3V5724Y4P2YGZGNT267KOAIR434IOUY3LOCTWQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:51704->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.268547236 (225h24m52.820017697s) [noise=true , address=81.171.14.70:4041    , piece_id=XSWFTNAZ7H3F2LOD5KRUIPKT3K4EO5FIF45TEKL3GZRXOZBXCCQA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:32986->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.268586190 (225h24m52.820056651s) [noise=true , address=81.171.14.70:4043    , piece_id=5B73XAI3QMFSIPL22F2N5CZRKWLEJWBVXYNE67AAMXIGUIK54AOA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:28:54.268666282 (225h24m52.820136743s) [noise=true , address=81.171.14.70:4047    , piece_id=4OZEVNAFVNAKPCO2L7ADMV37TWUOI4J65ACZFFHXPNHQWBO45EPQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:52782->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.268733941 (225h24m52.820204402s) [noise=true , address=81.171.14.70:4042    , piece_id=BREL6IRSSIGMBMGXSWESYLAXVQ6TEIK6ERUEYLBF7DSGVN65ATSA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:28:54.268771863 (225h24m52.820242314s) [noise=true , address=81.171.14.70:4035    , piece_id=YRBGBWX3BVF44S7BOLRJZW3OSGC2NJX2EXXFSLOFTEE4XTYQDQLQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: read tcp 188.166.225.170:38228->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.268957618 (225h24m52.820428079s) [noise=true , address=81.171.14.70:4031    , piece_id=OJUZCT4CBKUEKGA6VRXIETJQET7W3X3XD53LTKLVAWDRXNXJ74IQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:28:54.269011339 (225h24m52.82048179s) [noise=true , address=81.171.14.70:4032    , piece_id=FXZ23EUQINKHYVPTVXYUYGPLOJBKIV4Y2ELZJXCQYNVZUEPA6JAQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: read tcp 188.166.225.170:42104->81.171.14.70:4032: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.269157207 (225h24m52.820627678s) [noise=true , address=81.171.14.70:4030    , piece_id=PMMS5MRAROQKF4CM6HJS7GOKVPMC7HA4EJFSXTTJJPKAOCEKOG6A, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: read tcp 188.166.225.170:48622->81.171.14.70:4030: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.269254072 (225h24m52.820724533s) [seg_pos={0 0}, upload=198510]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Nov 18 17:28:54.437452321 (225h24m52.988922782s) [upload=198510]: Done uploading segments...
Nov 18 17:28:54.437491736 (225h24m52.988962197s) [upload=198510]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 6.249203506s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
1m0.17196731s
trace:
https://jaeger.dev.storj.io/trace/6846782f31badfad
FAIL (2025-11-18 17:28:54 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
.147:4022  , piece_id=FOY3JLRUJLRK6O4P3C6AODB6BPKPQVS3FELWDLFABQZXQQAEAOTQ, seg_pos={0 0}, upload=198510]: Uploading piece...
Nov 18 17:27:54.918502382 (225h23m53.469972843s) [noise=true , address=89.149.201.147:4015  , piece_id=TCXDQOAOLSWRC3XDJOVZ5ZDCVYQVYHLHPPPJCQJE3533D6NF3ZCQ, seg_pos={0 0}, upload=198510]: Uploading piece...
Nov 18 17:27:54.918944945 (225h23m53.470415406s) [noise=true , address=89.149.201.147:4011  , piece_id=L47JVOM6VAZBKSMDYQ23SOPKFHYJXWVAF4NYPD35UMDYXS5LDE7A, seg_pos={0 0}, upload=198510]: Uploading piece...
Nov 18 17:27:54.919351870 (225h23m53.470822331s) [noise=true , address=81.171.14.70:4040    , piece_id=5XM6H5PHTYLS3C3V5724Y4P2YGZGNT267KOAIR434IOUY3LOCTWQ, seg_pos={0 0}, upload=198510]: Uploading piece...
Nov 18 17:27:56.205024971 (225h23m54.756495432s) [upload=198510]: Next returned nil segment
Nov 18 17:27:56.205036592 (225h23m54.756507053s) [upload=198510]: Waiting for error group managing segments...
Nov 18 17:27:56.810747814 (225h23m55.362218275s) [noise=true , address=185.167.204.205:4034 , piece_id=EGQXLFTJRJVKYE4NF6N5MZL2OG6222JSYYK5DX5MNBHQF32C4W7A, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:56.827677882 (225h23m55.379148343s) [noise=true , address=185.167.204.206:4060 , piece_id=SW5OY5YFJ3VIZEEVKVRX4A2NJS4ZX4JMS7VS6O7TT3VRUCQCBRBA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:56.850030165 (225h23m55.401500626s) [noise=true , address=185.167.204.206:4041 , piece_id=N7TKXSNP4MXS6B6GQ2DJK6TWY7X3N3UEPFMHGD6S6HHP7IKPQFZQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.343059069 (225h23m55.89452952s) [noise=true , address=89.149.201.147:4022  , piece_id=FOY3JLRUJLRK6O4P3C6AODB6BPKPQVS3FELWDLFABQZXQQAEAOTQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.374394879 (225h23m55.92586533s) [noise=true , address=89.149.201.147:4011  , piece_id=L47JVOM6VAZBKSMDYQ23SOPKFHYJXWVAF4NYPD35UMDYXS5LDE7A, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.377007934 (225h23m55.928478395s) [noise=true , address=89.149.201.147:4005  , piece_id=HRH5T6TFGMGWJD3ZXZKKB47DLPX2NDUFTZ6PLRCBSW6JWIMOFY4A, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.403439314 (225h23m55.954909765s) [noise=true , address=89.149.201.147:4009  , piece_id=ZS767QXDTTFML6CL6UM2A2QLHCAGOJRBQB73HE7RVPY6HJCL2KVA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.427817104 (225h23m55.979287555s) [noise=true , address=89.149.201.147:4021  , piece_id=3EZ36VL7JG4ZLCMB74CI3NYONADYQOLLUQUMPLX2Z6OG6KQKKFEA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.629356120 (225h23m56.180826581s) [noise=true , address=185.167.204.205:4021 , piece_id=7RXLEAKF6BMBAOBHE7K3HTK7HTVR5WGI4Y6XNCEPJKUXUKZEGXGA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.863697377 (225h23m56.415167828s) [noise=true , address=185.167.204.206:4047 , piece_id=25GKJRMEID55XBUOT4YHBH2NNQWHHGBLUAQ6QKRUDGZHMGAQTKJA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.921360007 (225h23m56.472830468s) [noise=true , address=89.149.201.147:4020  , piece_id=YIWOUCYK4ENQOBCXXLG3GTHOV52AQ2PHGM72SNQKMYW4UJ44LV5Q, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:57.968503207 (225h23m56.519973668s) [noise=true , address=89.149.201.147:4015  , piece_id=TCXDQOAOLSWRC3XDJOVZ5ZDCVYQVYHLHPPPJCQJE3533D6NF3ZCQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.105114990 (225h23m56.656585451s) [noise=true , address=185.167.204.205:4005 , piece_id=3KZRXOMXLDMVWNZWEURV32CVXDRN3Z7FGZWYE4PSOZH2MGLDREEA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.142605799 (225h23m56.69407626s) [noise=true , address=185.167.204.205:4019 , piece_id=ZCPCSEI7J7VPIT7LDH2T7NNNITBX2633LEHPQDZRUA2Z7PW5QPTA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.328022384 (225h23m56.879492875s) [noise=true , address=185.167.204.205:4010 , piece_id=KST4NIBRUIXI3YH5U7MU2NOXP3DSU7UG7BKM3JKQLLT5BETOEFGA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.399161546 (225h23m56.950632007s) [noise=true , address=185.167.204.206:4056 , piece_id=ZBEFERR6LVJVZSPICRBOF7HPOPPFFQKKZ5FCPOQMO6RAJYQSGWSQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:27:58.880210359 (225h23m57.43168081s) [noise=true , address=185.167.204.205:4032 , piece_id=E3FUKWUYYFDNRWGF755SI46OHPV6SBQE6YY4LZ3TUBPR2HDCO7BQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:28:51.027529862 (225h24m49.579000323s) [noise=true , address=81.171.14.70:4029    , piece_id=22XHKKNZEGV7IPDYPLS4MZVKR3YSWC57RP4L6BIECFWELIKV3YJA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: <nil>
Nov 18 17:28:54.268315084 (225h24m52.819785545s) [noise=true , address=81.171.14.70:4039    , piece_id=3QDZDOONZDGMARA6RUM3E4NNINXZ5NZNGCE4XAS4XMS27ZJ3IIMQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, address:81.171.14.70:4039): protocol: write tcp 188.166.225.170:44042->81.171.14.70:4039: use of closed network connection; write tcp 188.166.225.170:44042->81.171.14.70:4039: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44042->81.171.14.70:4039: use of closed network connection
Nov 18 17:28:54.268392841 (225h24m52.819863302s) [noise=true , address=81.171.14.70:4040    , piece_id=5XM6H5PHTYLS3C3V5724Y4P2YGZGNT267KOAIR434IOUY3LOCTWQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: read tcp 188.166.225.170:51704->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.268547236 (225h24m52.820017697s) [noise=true , address=81.171.14.70:4041    , piece_id=XSWFTNAZ7H3F2LOD5KRUIPKT3K4EO5FIF45TEKL3GZRXOZBXCCQA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: read tcp 188.166.225.170:32986->81.171.14.70:4041: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.268586190 (225h24m52.820056651s) [noise=true , address=81.171.14.70:4043    , piece_id=5B73XAI3QMFSIPL22F2N5CZRKWLEJWBVXYNE67AAMXIGUIK54AOA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:28:54.268666282 (225h24m52.820136743s) [noise=true , address=81.171.14.70:4047    , piece_id=4OZEVNAFVNAKPCO2L7ADMV37TWUOI4J65ACZFFHXPNHQWBO45EPQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 188.166.225.170:52782->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.268733941 (225h24m52.820204402s) [noise=true , address=81.171.14.70:4042    , piece_id=BREL6IRSSIGMBMGXSWESYLAXVQ6TEIK6ERUEYLBF7DSGVN65ATSA, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:28:54.268771863 (225h24m52.820242314s) [noise=true , address=81.171.14.70:4035    , piece_id=YRBGBWX3BVF44S7BOLRJZW3OSGC2NJX2EXXFSLOFTEE4XTYQDQLQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: read tcp 188.166.225.170:38228->81.171.14.70:4035: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.268957618 (225h24m52.820428079s) [noise=true , address=81.171.14.70:4031    , piece_id=OJUZCT4CBKUEKGA6VRXIETJQET7W3X3XD53LTKLVAWDRXNXJ74IQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng, address:81.171.14.70:4031): protocol: expected piece hash; context deadline exceeded; EOF
Nov 18 17:28:54.269011339 (225h24m52.82048179s) [noise=true , address=81.171.14.70:4032    , piece_id=FXZ23EUQINKHYVPTVXYUYGPLOJBKIV4Y2ELZJXCQYNVZUEPA6JAQ, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf, address:81.171.14.70:4032): protocol: read tcp 188.166.225.170:42104->81.171.14.70:4032: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.269157207 (225h24m52.820627678s) [noise=true , address=81.171.14.70:4030    , piece_id=PMMS5MRAROQKF4CM6HJS7GOKVPMC7HA4EJFSXTTJJPKAOCEKOG6A, seg_pos={0 0}, upload=198510]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: read tcp 188.166.225.170:48622->81.171.14.70:4030: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 18 17:28:54.269254072 (225h24m52.820724533s) [seg_pos={0 0}, upload=198510]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Nov 18 17:28:54.437452321 (225h24m52.988922782s) [upload=198510]: Done uploading segments...
Nov 18 17:28:54.437491736 (225h24m52.988962197s) [upload=198510]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 1m0.171984193s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................]
duration:
3.404959245s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 17:07:10 UTC)
orbiter warning: context deadline exceeded
Duration: 3.404979924s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................]
duration:
3.615600474s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 17:06:51 UTC)
orbiter warning: context deadline exceeded
Duration: 3.615630642s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................]
duration:
3.545417523s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 17:06:15 UTC)
orbiter warning: context deadline exceeded
Duration: 3.545437731s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................]
duration:
3.549441905s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 17:05:13 UTC)
orbiter warning: context deadline exceeded
Duration: 3.549470899s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................]
duration:
3.55299962s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 17:03:58 UTC)
orbiter warning: context deadline exceeded
Duration: 3.553024146s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [X....X......................................................]
duration:
3.524122351s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 17:02:57 UTC)
orbiter warning: context deadline exceeded
Duration: 3.524152008s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.X....X.....................................................]
duration:
3.442369039s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 17:01:48 UTC)
orbiter warning: context deadline exceeded
Duration: 3.442398335s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [..X....X....................................................]
duration:
3.554554731s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 17:00:57 UTC)
orbiter warning: context deadline exceeded
Duration: 3.554581312s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [...X....X...................................................]
duration:
3.485751758s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 17:00:38 UTC)
orbiter warning: context deadline exceeded
Duration: 3.485789459s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [....X....X..................................................]
duration:
3.588206303s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:59:43 UTC)
orbiter warning: context deadline exceeded
Duration: 3.588239255s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.....X....X.................................................]
duration:
3.52285007s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:59:06 UTC)
orbiter warning: context deadline exceeded
Duration: 3.522882162s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [......X....X................................................]
duration:
3.653503778s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:58:12 UTC)
orbiter warning: context deadline exceeded
Duration: 3.653534298s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.......X....X...............................................]
duration:
3.563646997s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:56:59 UTC)
orbiter warning: context deadline exceeded
Duration: 3.563697342s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [........X....X..............................................]
duration:
3.51046999s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:56:38 UTC)
orbiter warning: context deadline exceeded
Duration: 3.510599266s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [.........X....X.............................................]
duration:
3.466075271s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:56:10 UTC)
orbiter warning: context deadline exceeded
Duration: 3.466103346s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [..........X....X............................................]
duration:
3.627466651s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:55:44 UTC)
orbiter warning: context deadline exceeded
Duration: 3.627491528s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=6) [...........X....X...........................................]
duration:
3.48502694s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:54:46 UTC)
orbiter warning: context deadline exceeded
Duration: 3.485053239s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
3 out of 60 is failed (threshold=6) [X...........X....X..........................................]
duration:
3.490952252s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:54:30 UTC)
orbiter warning: context deadline exceeded
Duration: 3.491053765s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
3 out of 60 is failed (threshold=6) [.X...........X....X.........................................]
duration:
3.464658827s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:54:07 UTC)
orbiter warning: context deadline exceeded
Duration: 3.464676249s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
3 out of 60 is failed (threshold=6) [..X...........X....X........................................]
duration:
3.389926401s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:53:26 UTC)
orbiter warning: context deadline exceeded
Duration: 3.389963342s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
3 out of 60 is failed (threshold=6) [...X...........X....X.......................................]
duration:
3.510740491s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:53:10 UTC)
orbiter warning: context deadline exceeded
Duration: 3.510851804s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
4 out of 60 is failed (threshold=6) [X...X...........X....X......................................]
duration:
3.533999162s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:52:34 UTC)
orbiter warning: context deadline exceeded
Duration: 3.534033056s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
5 out of 60 is failed (threshold=6) [XX...X...........X....X.....................................]
duration:
3.54330411s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:51:45 UTC)
orbiter warning: context deadline exceeded
Duration: 3.543329248s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
5 out of 60 is failed (threshold=6) [.XX...X...........X....X....................................]
duration:
3.477129512s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:50:42 UTC)
orbiter warning: context deadline exceeded
Duration: 3.477157185s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
5 out of 60 is failed (threshold=6) [..XX...X...........X....X...................................]
duration:
3.413079324s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:50:00 UTC)
orbiter warning: context deadline exceeded
Duration: 3.413108779s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
5 out of 60 is failed (threshold=6) [...XX...X...........X....X..................................]
duration:
3.532569309s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:49:23 UTC)
orbiter warning: context deadline exceeded
Duration: 3.532782396s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
6 out of 60 is failed (threshold=6) [X...XX...X...........X....X.................................]
duration:
3.410530697s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:48:15 UTC)
orbiter warning: context deadline exceeded
Duration: 3.410558389s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
6 out of 60 is failed (threshold=6) [.X...XX...X...........X....X................................]
duration:
3.493336052s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:47:57 UTC)
orbiter warning: context deadline exceeded
Duration: 3.493363926s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
6 out of 60 is failed (threshold=6) [..X...XX...X...........X....X...............................]
duration:
3.626830951s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:47:05 UTC)
orbiter warning: context deadline exceeded
Duration: 3.626863102s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
6 out of 60 is failed (threshold=6) [...X...XX...X...........X....X..............................]
duration:
3.540006339s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:46:05 UTC)
orbiter warning: context deadline exceeded
Duration: 3.540044312s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
7 out of 60 is failed (threshold=6) [X...X...XX...X...........X....X.............................]
duration:
3.52627809s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:45:46 UTC)
orbiter warning: context deadline exceeded
Duration: 3.526304741s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
8 out of 60 is failed (threshold=6) [XX...X...XX...X...........X....X............................]
duration:
3.420977018s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:44:50 UTC)
orbiter warning: context deadline exceeded
Duration: 3.421001024s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
8 out of 60 is failed (threshold=6) [.XX...X...XX...X...........X....X...........................]
duration:
3.624060665s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:44:05 UTC)
orbiter warning: context deadline exceeded
Duration: 3.624096193s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
8 out of 60 is failed (threshold=6) [..XX...X...XX...X...........X....X..........................]
duration:
3.668663998s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:43:20 UTC)
orbiter warning: context deadline exceeded
Duration: 3.66870263s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
8 out of 60 is failed (threshold=6) [...XX...X...XX...X...........X....X.........................]
duration:
3.453724126s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:42:41 UTC)
orbiter warning: context deadline exceeded
Duration: 3.453744345s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
8 out of 60 is failed (threshold=6) [....XX...X...XX...X...........X....X........................]
duration:
3.508375407s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:41:56 UTC)
orbiter warning: context deadline exceeded
Duration: 3.508418579s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
9 out of 60 is failed (threshold=6) [X....XX...X...XX...X...........X....X.......................]
duration:
3.626918443s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:41:33 UTC)
orbiter warning: context deadline exceeded
Duration: 3.626951618s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
9 out of 60 is failed (threshold=6) [.X....XX...X...XX...X...........X....X......................]
duration:
3.455848036s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:40:51 UTC)
orbiter warning: context deadline exceeded
Duration: 3.455876921s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
9 out of 60 is failed (threshold=6) [..X....XX...X...XX...X...........X....X.....................]
duration:
4.317562482s
trace:
https://jaeger.dev.storj.io/trace/7ccb815790dbb9de
FAIL (2025-11-18 16:40:21 UTC)
orbiter warning: context deadline exceeded
Duration: 4.317593622s core uplink us-select-1 us1-placement-20