Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........XXXX...............................................] duration:
4.785044632s
FAIL (2025-07-05 20:43:58 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.785069399s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........XXXX..............................................] duration:
4.824186258s
FAIL (2025-07-05 20:43:24 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.824212859s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........XXXX.............................................] duration:
4.820982983s
FAIL (2025-07-05 20:43:00 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.821006458s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............XXXX............................................] duration:
4.85348214s
FAIL (2025-07-05 20:41:54 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.853512589s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.............XXXX...........................................] duration:
4.83275033s
FAIL (2025-07-05 20:41:17 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.832778063s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..............XXXX..........................................] duration:
4.894773845s
FAIL (2025-07-05 20:40:48 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.894800126s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...............XXXX.........................................] duration:
4.886696345s
FAIL (2025-07-05 20:40:14 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.886730179s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................XXXX........................................] duration:
4.888737881s
FAIL (2025-07-05 20:39:12 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.888770053s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.................XXXX.......................................] duration:
4.846952624s
FAIL (2025-07-05 20:38:32 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.846974878s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..................XXXX......................................] duration:
4.842815959s
FAIL (2025-07-05 20:37:41 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.84283777s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...................XXXX.....................................] duration:
4.869154847s
FAIL (2025-07-05 20:36:51 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.86918214s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....................XXXX....................................] duration:
4.8263555s
FAIL (2025-07-05 20:36:14 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.826386859s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....................XXXX...................................] duration:
4.844464062s
FAIL (2025-07-05 20:35:59 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.8444896s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......................XXXX..................................] duration:
4.889042765s
FAIL (2025-07-05 20:34:52 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.889068934s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......................XXXX.................................] duration:
4.77780109s
FAIL (2025-07-05 20:34:32 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.777821358s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........................XXXX................................] duration:
4.844008299s
FAIL (2025-07-05 20:33:19 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.844037586s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........................XXXX...............................] duration:
4.869123438s
FAIL (2025-07-05 20:32:09 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.869152193s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........................XXXX..............................] duration:
4.870642316s
FAIL (2025-07-05 20:31:10 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.870672794s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........................XXXX.............................] duration:
4.745858802s
FAIL (2025-07-05 20:30:35 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.745886394s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............................XXXX............................] duration:
4.844690525s
FAIL (2025-07-05 20:29:59 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.844717247s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.............................XXXX...........................] duration:
4.808953398s
FAIL (2025-07-05 20:28:57 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.80898568s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..............................XXXX..........................] duration:
4.81411746s
FAIL (2025-07-05 20:28:17 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.814139793s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...............................XXXX.........................] duration:
4.863861619s
FAIL (2025-07-05 20:27:57 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.863884874s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................................XXXX........................] duration:
4.972655334s
FAIL (2025-07-05 20:27:14 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.972680141s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.................................XXXX.......................] duration:
4.871866724s
FAIL (2025-07-05 20:26:23 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.87189058s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..................................XXXX......................] duration:
4.848469422s
FAIL (2025-07-05 20:25:47 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.848498297s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...................................XXXX.....................] duration:
4.825485505s
FAIL (2025-07-05 20:25:25 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.825521142s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....................................XXXX....................] duration:
4.880487327s
FAIL (2025-07-05 20:25:06 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.880563614s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....................................XXXX...................] duration:
4.908251992s
FAIL (2025-07-05 20:24:01 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.908280418s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......................................XXXX..................] duration:
4.844932841s
FAIL (2025-07-05 20:23:03 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.844956685s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......................................XXXX.................] duration:
4.918507236s
FAIL (2025-07-05 20:22:38 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.918533796s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........................................XXXX................] duration:
4.827474258s
FAIL (2025-07-05 20:21:43 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.827502851s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........................................XXXX...............] duration:
4.921087836s
FAIL (2025-07-05 20:20:55 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.92111099s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........................................XXXX..............] duration:
4.867105357s
FAIL (2025-07-05 20:20:37 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.867201731s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........................................XXXX.............] duration:
4.876356729s
FAIL (2025-07-05 20:20:05 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.876380183s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............................................XXXX............] duration:
4.779758531s
FAIL (2025-07-05 20:18:55 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.779795321s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.............................................XXXX...........] duration:
4.82622404s
FAIL (2025-07-05 20:18:10 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.826250179s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..............................................XXXX..........] duration:
4.840494789s
FAIL (2025-07-05 20:17:47 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.840520679s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...............................................XXXX.........] duration:
4.956783808s
FAIL (2025-07-05 20:17:16 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.956810048s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................................................XXXX........] duration:
4.829542699s
FAIL (2025-07-05 20:16:19 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.829559572s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.................................................XXXX.......] duration:
4.796519041s
FAIL (2025-07-05 20:16:00 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.796545914s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..................................................XXXX......] duration:
4.830567051s
FAIL (2025-07-05 20:15:10 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.830593331s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...................................................XXXX.....] duration:
4.811789305s
FAIL (2025-07-05 20:14:27 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.811811818s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....................................................XXXX....] duration:
4.813478648s
FAIL (2025-07-05 20:14:10 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.813523525s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....................................................XXXX...] duration:
4.842230029s
FAIL (2025-07-05 20:13:19 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.842252521s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......................................................XXXX..] duration:
4.870956406s
FAIL (2025-07-05 20:12:55 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.8710059s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......................................................XXXX.] duration:
4.930712256s
FAIL (2025-07-05 20:11:48 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.930726432s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........................................................XXXX] duration:
1m0.179186794s
FAIL (2025-07-05 20:11:43 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 1m0.17921591s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX] duration:
1m0.17726861s
FAIL (2025-07-05 20:10:30 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
04 (298h59m6.214390439s) [noise=true , address=89.149.201.147:4012 , piece_id=JHLGDFTD3DXQTSOJVSFB4YHEFLU4MRWE2WKUKJ3WIAOIFLNE7HOA, seg_pos={0 0}, upload=239096]: Uploading piece...
Jul 5 20:09:31.443824628 (298h59m6.214465963s) [noise=true , address=89.149.201.147:4007 , piece_id=RNMAQJOPVUIDEUDCVWTU42GAUAR2GWFFJZIKTGJNE4PYLHBBJYKA, seg_pos={0 0}, upload=239096]: Uploading piece...
Jul 5 20:09:31.443969466 (298h59m6.214610801s) [noise=true , address=89.149.201.147:4004 , piece_id=CLJSM7TUANN7H74BSNAJXUMMWFRA7NPAWRDCGPBCN2SKGC57AAKA, seg_pos={0 0}, upload=239096]: Uploading piece...
Jul 5 20:09:31.444011506 (298h59m6.214652841s) [noise=true , address=185.167.204.206:4070 , piece_id=X77TIVCASFW36GQUNC6KDI6DVU7OFWO2WYCZD6GBT6VAAPE77XMA, seg_pos={0 0}, upload=239096]: Uploading piece...
Jul 5 20:09:31.444246195 (298h59m6.21488752s) [noise=true , address=185.167.204.206:4063 , piece_id=CLMETJONTDLEWISQM4TJTFLXNGYRT5KLU2OFZ4DZQY7ZG2YM7CEQ, seg_pos={0 0}, upload=239096]: Uploading piece...
Jul 5 20:09:31.445559878 (298h59m6.216201213s) [noise=true , address=81.171.14.70:4036 , piece_id=B6XSFSEGCQISYJ7IP53FHD6ISFL5ITWCNEOLDBO54UNXY37LI4LQ, seg_pos={0 0}, upload=239096]: Uploading piece...
Jul 5 20:09:31.445830906 (298h59m6.216472241s) [noise=true , address=81.171.14.70:4042 , piece_id=KBHBOT6LJFOIA7GAR73SAWYGJYY4SARERVOJ3SD5FDIL7HVAL6CQ, seg_pos={0 0}, upload=239096]: Uploading piece...
Jul 5 20:09:32.262623883 (298h59m7.033265218s) [upload=239096]: Next returned nil segment
Jul 5 20:09:32.262636948 (298h59m7.033278283s) [upload=239096]: Waiting for error group managing segments...
Jul 5 20:09:32.635975189 (298h59m7.406616524s) [noise=true , address=81.171.14.70:4036 , piece_id=B6XSFSEGCQISYJ7IP53FHD6ISFL5ITWCNEOLDBO54UNXY37LI4LQ, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.640717071 (298h59m7.411358406s) [noise=true , address=89.149.201.147:4005 , piece_id=DVHV3Q7GODIIYJSGSMNSXULLFTR5AX54HZWJ533JUIW2L34FDECA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.643500616 (298h59m7.414141951s) [noise=true , address=81.171.14.70:4039 , piece_id=HKEAHORCBFYVKRDZUQ44XDOI27KPD5TJHXOJN6SCSQCB2RZKTS6Q, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.650382491 (298h59m7.421023827s) [noise=true , address=89.149.201.147:4023 , piece_id=HPM26F3SCJNDXWUBT6A6SS7N5SUQXRXZKUWVJWQQN54QAAZLWUPQ, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.651270370 (298h59m7.421911705s) [noise=true , address=89.149.201.147:4012 , piece_id=JHLGDFTD3DXQTSOJVSFB4YHEFLU4MRWE2WKUKJ3WIAOIFLNE7HOA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.651555235 (298h59m7.42219657s) [noise=true , address=89.149.201.147:4006 , piece_id=X3RMAI5K5GBLYSZF5TTGQSCGGJKZUFENUEDLVGFNCXZHFVYYFXXA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.651634426 (298h59m7.422275761s) [noise=true , address=89.149.201.147:4007 , piece_id=RNMAQJOPVUIDEUDCVWTU42GAUAR2GWFFJZIKTGJNE4PYLHBBJYKA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.653792645 (298h59m7.42443398s) [noise=true , address=81.171.14.70:4029 , piece_id=3TURVZI3LTABL75RYJWYBBMOG73BZIOYTV3JUJIJAR5SDDFUXE6A, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.658577950 (298h59m7.429219295s) [noise=true , address=81.171.14.70:4032 , piece_id=I3ACPVF6DQUAN3AFVSCRE66KKQBPUSJATWWOQAHVJ6LS7T7LF7HA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.661356195 (298h59m7.43199753s) [noise=true , address=81.171.14.70:4028 , piece_id=YUW73OMW2EFGKPD37K3K7FGTU7Y4SJ6NPBGNLGBI252TZU65WKOA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.662993968 (298h59m7.433635303s) [noise=true , address=89.149.201.147:4013 , piece_id=TFCPLTKF7WPD5E5KSSZE7R32KRMVINFXJKK4H2GGHFYX4JKUCG6A, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.664003911 (298h59m7.434645246s) [noise=true , address=89.149.201.147:4003 , piece_id=PXDBYEP7PWDVUC6LJKW2XJMCRHELZZS7RR4M3CGLWZA6BYOYJ7MA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.666437276 (298h59m7.437078611s) [noise=true , address=81.171.14.70:4045 , piece_id=AS7HOT4OVACSTR4BSP2J36IBFOCBAFJACM7BE5SNLL3YCT7DRTKQ, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.669236341 (298h59m7.439877676s) [noise=true , address=81.171.14.70:4034 , piece_id=4T2G7SPQZLOSAOXDMBDZHXSOPPPK7P2VWGC3CNPEMRGYXYDT7EPA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.676302378 (298h59m7.446943713s) [noise=true , address=89.149.201.147:4020 , piece_id=HHL7MHTP4BPTC2NKXEPOQAB4IP5Y67XXKW7ZTOXIHLQUCTNH3SDQ, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.679250278 (298h59m7.449891643s) [noise=true , address=81.171.14.70:4035 , piece_id=IINSIWMHUF44R2HDARJKISPAGYYIP7XRJJKPAFAYFUAMOK6PJYEQ, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.680777119 (298h59m7.451418464s) [noise=true , address=81.171.14.70:4041 , piece_id=RCKMAAAQZZQQMLFB27Q7IZGXQD5GQ7FPT3U6XHY3FVYIABXWWX2A, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.687738918 (298h59m7.458380263s) [noise=true , address=89.149.201.147:4004 , piece_id=CLJSM7TUANN7H74BSNAJXUMMWFRA7NPAWRDCGPBCN2SKGC57AAKA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.688573284 (298h59m7.459214619s) [noise=true , address=89.149.201.147:4011 , piece_id=WLNKUU35X5IJMSFFSHBS7DU2PEGA6GV6E6UABWQC2NHBGXA2UVUA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.700314706 (298h59m7.470956041s) [noise=true , address=81.171.14.70:4047 , piece_id=5VP7T3OMBSKFLOPGKVWQ4N7M5C3OM2RI6JYEUXL6VFSWNY3I7OCQ, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:09:32.720185631 (298h59m7.490826966s) [noise=true , address=81.171.14.70:4042 , piece_id=KBHBOT6LJFOIA7GAR73SAWYGJYY4SARERVOJ3SD5FDIL7HVAL6CQ, seg_pos={0 0}, upload=239096]: Done uploading piece. err: <nil>
Jul 5 20:10:30.633099198 (299h0m5.403740534s) [noise=true , address=185.167.204.206:4039 , piece_id=54JV3MEYGD7RMR5RB54QWLBNBPN63DS6GSAOIMKOABXIJF5CSKKA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: ecclient: upload failed (node:12FV1y64fPXx14kCr3Tng2sYqXdsxaPeRJXmNVJLCVKQNkCo3Y9, address:185.167.204.206:4039): protocol: write tcp 188.166.225.170:43592->185.167.204.206:4039: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:10:30.633183991 (299h0m5.403825326s) [noise=true , address=185.167.204.206:4044 , piece_id=XDQNJDCYITJILDV4QXXRC23H6MELQVQBCF2GY2SNDMHJFJCFKPVA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: ecclient: upload failed (node:1216DSoBdbhQNEkdg1TtfmYRJrUjLxCHKvdkhB1axUiaDNXGrrj, address:185.167.204.206:4044): protocol: write tcp 188.166.225.170:32834->185.167.204.206:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:10:30.633215401 (299h0m5.403856736s) [noise=true , address=185.167.204.206:4070 , piece_id=X77TIVCASFW36GQUNC6KDI6DVU7OFWO2WYCZD6GBT6VAAPE77XMA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: ecclient: upload failed (node:1HjpnutE3cSKeeVw3nEvoPPAbJKjP6VZYMDGLeT9zSskkwzBUz, address:185.167.204.206:4070): protocol: write tcp 188.166.225.170:43980->185.167.204.206:4070: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:10:30.633302878 (299h0m5.403944213s) [noise=true , address=185.167.204.206:4058 , piece_id=I4M5DLTOILDP66CF7SSPERDPGA35O6MOCJ4NP7CA2GFZG757AV2Q, seg_pos={0 0}, upload=239096]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: write tcp 188.166.225.170:41406->185.167.204.206:4058: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:10:30.633321854 (299h0m5.403963189s) [noise=true , address=185.167.204.206:4059 , piece_id=IS7WHCJSUC7DN4OX6ES3UN4U5SBMO4ZDYP2XYKJWBJ6SVY2NQPKA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:10:30.633354747 (299h0m5.403996082s) [noise=true , address=185.167.204.205:4009 , piece_id=UPTTGDLNM4IUPBCLG72IHQAJQT3NBN2RTITBFLK6Y73KBMMXHGOA, seg_pos={0 0}, upload=239096]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:36908->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:10:30.633368733 (299h0m5.404010068s) [noise=true , address=185.167.204.206:4063 , piece_id=CLMETJONTDLEWISQM4TJTFLXNGYRT5KLU2OFZ4DZQY7ZG2YM7CEQ, seg_pos={0 0}, upload=239096]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: write tcp 188.166.225.170:49220->185.167.204.206:4063: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:10:30.633397038 (299h0m5.404038373s) [seg_pos={0 0}, upload=239096]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Jul 5 20:10:30.807512768 (299h0m5.578154103s) [upload=239096]: Done uploading segments...
Jul 5 20:10:30.807546844 (299h0m5.578188189s) [upload=239096]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 1m0.177288269s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
1m0.183336874s
FAIL (2025-07-05 20:09:30 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
pos={0 0}, upload=239084]: Uploading piece...
Jul 5 20:08:31.052668236 (298h58m5.823309571s) [noise=true , address=81.171.14.70:4036 , piece_id=RSYG2UEYKEWA4SL7LNJYUYBB4Q7NEU7FBQCZ7FRAX2QM7P5DBDSQ, seg_pos={0 0}, upload=239084]: Uploading piece...
Jul 5 20:08:31.052903245 (298h58m5.82354457s) [noise=true , address=89.149.201.147:4006 , piece_id=VCBOP5QCR7FS532OYQKLGDCGWUA5H5GZ4V3EZKIMD4J3IJHDLETA, seg_pos={0 0}, upload=239084]: Uploading piece...
Jul 5 20:08:31.053168192 (298h58m5.823809527s) [noise=true , address=81.171.14.70:4027 , piece_id=FYJI4OSGK44CAFQC6VWUFA35F7QXLFJGJXHTXVTQYSQVGUPNAAXA, seg_pos={0 0}, upload=239084]: Uploading piece...
Jul 5 20:08:31.053388844 (298h58m5.82403017s) [noise=true , address=185.167.204.205:4033 , piece_id=7ZVQCCIICEQQH24IKHZJ65CHHY2T23QOZVUABNR7TRXIC7BXRMGA, seg_pos={0 0}, upload=239084]: Uploading piece...
Jul 5 20:08:31.780128819 (298h58m6.550770154s) [upload=239084]: Next returned nil segment
Jul 5 20:08:31.780142906 (298h58m6.550784241s) [upload=239084]: Waiting for error group managing segments...
Jul 5 20:08:32.248253437 (298h58m7.018894762s) [noise=true , address=89.149.201.147:4024 , piece_id=THA27KFZEZOGKIERHXPWT64BJWRO7LFNTI7KSD5HTVCH5BPRJWPQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.249426441 (298h58m7.020067827s) [noise=true , address=89.149.201.147:4010 , piece_id=6U77K2EVJVJKXTOJXAJUR5GONUCK7QYIKXS4F6B4VOZQQZPRSJKQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.249594643 (298h58m7.020235978s) [noise=true , address=89.149.201.147:4012 , piece_id=422Q5MYQT2ZNWVA4TF4TF2TRD5DJT45KGT4PFXDSJP4JHN2DGCEQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.251526229 (298h58m7.022167564s) [noise=true , address=89.149.201.147:4006 , piece_id=VCBOP5QCR7FS532OYQKLGDCGWUA5H5GZ4V3EZKIMD4J3IJHDLETA, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.253140236 (298h58m7.023781571s) [noise=true , address=81.171.14.70:4040 , piece_id=JNXJNZDDXLV5PK6A343P4GGEIUTS2DNVWF7XOSCZTINRMMQWEULA, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.258309024 (298h58m7.028950359s) [noise=true , address=81.171.14.70:4048 , piece_id=NL72ISKKZVAK4ANEWIXYPX2K73YJQWYSSZ3Y66VMVCR2LKDSUSXA, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.258506482 (298h58m7.029147807s) [noise=true , address=81.171.14.70:4034 , piece_id=O5HTSG5CYSZF6GUMQ4DFV5OLLA6THRAOSFYTRHRVZQ5OKGHGVD6Q, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.261824440 (298h58m7.032465765s) [noise=true , address=81.171.14.70:4029 , piece_id=NA6YUV63BPR3WZOYJMW4BTG3ON4OX7ZDAMYIPQX36JGUI3B3IDWA, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.262077874 (298h58m7.032719209s) [noise=true , address=81.171.14.70:4032 , piece_id=U2C7XU2VT6W4LVBCAZTNDEEV4CKAXKN5E7L577S72F4CLNA62W2A, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.265948319 (298h58m7.036589654s) [noise=true , address=81.171.14.70:4031 , piece_id=4VKWWXNR3SLNQSSLT7GWHMC67LVNSNY73VK3T5B7LIX4WLME5PSQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.270841730 (298h58m7.041483065s) [noise=true , address=81.171.14.70:4030 , piece_id=7Z5KAR3PHXNUUXVONSCWDCL6XV7GJPM7AFGISDDSBYW5G4LMBH7Q, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.273282901 (298h58m7.043924236s) [noise=true , address=81.171.14.70:4027 , piece_id=FYJI4OSGK44CAFQC6VWUFA35F7QXLFJGJXHTXVTQYSQVGUPNAAXA, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.290787910 (298h58m7.061429255s) [noise=true , address=81.171.14.70:4043 , piece_id=D3M4PMD2K6FYVA5AQMUDIR6NMO3J4RUNTZJ6PGXSJJKCC5J3TBOA, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.296978041 (298h58m7.067619377s) [noise=true , address=81.171.14.70:4046 , piece_id=7J73I2DKA6RC2RXTPIQUNPFWMLTMA62LRWGD7D5SWEPFZH6U4M6A, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.298052527 (298h58m7.068693862s) [noise=true , address=89.149.201.147:4016 , piece_id=WZYGK4NORC5MYO5ZCRL3LZ5VEHSE25RD3UFWJAAR723KOGQHLWFQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.299734645 (298h58m7.07037598s) [noise=true , address=81.171.14.70:4045 , piece_id=PJUSIBUPAKKBKN66TS3LCKDA77YB2R24YLVUBTKBZK3PDR4JZMLQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.302548088 (298h58m7.073189423s) [noise=true , address=81.171.14.70:4041 , piece_id=GDJP6RYBSJNFSZV3FD775TD3R55J6FY6RYO7LLEGWWP4BWR75BUQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.309440373 (298h58m7.080081698s) [noise=true , address=81.171.14.70:4036 , piece_id=RSYG2UEYKEWA4SL7LNJYUYBB4Q7NEU7FBQCZ7FRAX2QM7P5DBDSQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:08:32.331839346 (298h58m7.102480681s) [noise=true , address=89.149.201.147:4022 , piece_id=FNBDLQF5PLDEIIOJM4PQ7D23MGDJCPVNO7SFRQI3GJOQRHLMTGGQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: <nil>
Jul 5 20:09:30.225612327 (298h59m4.996253663s) [noise=true , address=185.167.204.205:4004 , piece_id=Q2WMCR7QRYZ2F22ONYDBDACQCSCQ4UL2SL2IF32CTY4PO4YLZMHQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 188.166.225.170:40106->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:09:30.225665830 (298h59m4.996307165s) [noise=true , address=185.167.204.206:4063 , piece_id=FJRHPP4V54QTNERED2BDY3PGD72PWV5CG3UUAZJBD5WPNQR6EBTA, seg_pos={0 0}, upload=239084]: Done uploading piece. err: ecclient: upload failed (node:16qB6oqhjMfxCSDZJers7bCt7Eeomd3njuz1qR5F9PTpuoHX5U, address:185.167.204.206:4063): protocol: write tcp 188.166.225.170:55914->185.167.204.206:4063: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:09:30.225774338 (298h59m4.996415673s) [noise=true , address=185.167.204.205:4033 , piece_id=7ZVQCCIICEQQH24IKHZJ65CHHY2T23QOZVUABNR7TRXIC7BXRMGA, seg_pos={0 0}, upload=239084]: Done uploading piece. err: ecclient: upload failed (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe, address:185.167.204.205:4033): protocol: rpc: dial tcp 185.167.204.205:4033: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:09:30.225873938 (298h59m4.996515273s) [noise=true , address=185.167.204.206:4072 , piece_id=7457TWHXZJNA4HWAWNB4HMEMIPWXG5S7I5ETAJ2GGZXJI5HXBSCQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 188.166.225.170:46190->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:09:30.225918112 (298h59m4.996559447s) [noise=true , address=185.167.204.205:4012 , piece_id=IRFGDCYBNNT4RP26UPQHXEAETI4SFZRZ2MC4KDSZRULWQM4SUTIQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 188.166.225.170:43644->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:09:30.225949883 (298h59m4.996591218s) [noise=true , address=185.167.204.206:4057 , piece_id=E5Z4HUUVLQ6X3HREBPD7OI5LKSOQGJFLUICODBEPLWJI5T5ZLMCA, seg_pos={0 0}, upload=239084]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: write tcp 188.166.225.170:50270->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:09:30.225969671 (298h59m4.996611006s) [noise=true , address=185.167.204.205:4036 , piece_id=SNXYIU45ATZMB24FLHRE7RROCYLOVMFESZVFUHK3DKT7I2Z2TO5A, seg_pos={0 0}, upload=239084]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 188.166.225.170:45328->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:09:30.225993437 (298h59m4.996634772s) [noise=true , address=185.167.204.206:4052 , piece_id=HWVGRP4JFCJA5DWF2YQI5X7PUNVSECWTD2WGZH3U4GYNGWHRQN5Q, seg_pos={0 0}, upload=239084]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: write tcp 188.166.225.170:53490->185.167.204.206:4052: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:09:30.226008736 (298h59m4.996650071s) [noise=true , address=185.167.204.205:4008 , piece_id=VPL3TLPUI72PLZNZSFFAZF7GE5K4VTUIRWJ7UBED3QYMJ4YFQ5FQ, seg_pos={0 0}, upload=239084]: Done uploading piece. err: ecclient: upload failed (node:12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, address:185.167.204.205:4008): protocol: write tcp 188.166.225.170:46300->185.167.204.205:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:09:30.226023795 (298h59m4.99666513s) [seg_pos={0 0}, upload=239084]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 20:09:30.406237081 (298h59m5.176878416s) [upload=239084]: Done uploading segments...
Jul 5 20:09:30.406271667 (298h59m5.176913002s) [upload=239084]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 1m0.183358565s
core
uplink
eu-select-1
eu1-placement-15
|