Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [XXX.........................................................] duration:
4.913690581s
FAIL (2025-07-05 20:50:42 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.913720679s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [XXXX........................................................] duration:
4.822341881s
FAIL (2025-07-05 20:50:18 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.822382549s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.XXXX.......................................................] duration:
4.861910006s
FAIL (2025-07-05 20:49:41 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.861936035s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..XXXX......................................................] duration:
4.83749125s
FAIL (2025-07-05 20:48:38 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.837518512s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...XXXX.....................................................] duration:
4.89309354s
FAIL (2025-07-05 20:47:30 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.893116825s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....XXXX....................................................] duration:
4.845236627s
FAIL (2025-07-05 20:46:23 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.845260624s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....XXXX...................................................] duration:
4.840669189s
FAIL (2025-07-05 20:45:55 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.840695019s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......XXXX..................................................] duration:
4.887038436s
FAIL (2025-07-05 20:45:13 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.887065348s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......XXXX.................................................] duration:
4.84459976s
FAIL (2025-07-05 20:44:54 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.844628245s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........XXXX................................................] duration:
4.814043641s
FAIL (2025-07-05 20:44:24 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.814069843s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........XXXX...............................................] duration:
4.785044632s
FAIL (2025-07-05 20:43:58 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.785069399s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........XXXX..............................................] duration:
4.824186258s
FAIL (2025-07-05 20:43:24 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.824212859s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........XXXX.............................................] duration:
4.820982983s
FAIL (2025-07-05 20:43:00 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.821006458s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............XXXX............................................] duration:
4.85348214s
FAIL (2025-07-05 20:41:54 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.853512589s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.............XXXX...........................................] duration:
4.83275033s
FAIL (2025-07-05 20:41:17 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.832778063s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..............XXXX..........................................] duration:
4.894773845s
FAIL (2025-07-05 20:40:48 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.894800126s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...............XXXX.........................................] duration:
4.886696345s
FAIL (2025-07-05 20:40:14 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.886730179s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................XXXX........................................] duration:
4.888737881s
FAIL (2025-07-05 20:39:12 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.888770053s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.................XXXX.......................................] duration:
4.846952624s
FAIL (2025-07-05 20:38:32 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.846974878s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..................XXXX......................................] duration:
4.842815959s
FAIL (2025-07-05 20:37:41 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.84283777s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...................XXXX.....................................] duration:
4.869154847s
FAIL (2025-07-05 20:36:51 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.86918214s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....................XXXX....................................] duration:
4.8263555s
FAIL (2025-07-05 20:36:14 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.826386859s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....................XXXX...................................] duration:
4.844464062s
FAIL (2025-07-05 20:35:59 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.8444896s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......................XXXX..................................] duration:
4.889042765s
FAIL (2025-07-05 20:34:52 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.889068934s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......................XXXX.................................] duration:
4.77780109s
FAIL (2025-07-05 20:34:32 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.777821358s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........................XXXX................................] duration:
4.844008299s
FAIL (2025-07-05 20:33:19 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.844037586s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........................XXXX...............................] duration:
4.869123438s
FAIL (2025-07-05 20:32:09 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.869152193s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........................XXXX..............................] duration:
4.870642316s
FAIL (2025-07-05 20:31:10 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.870672794s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........................XXXX.............................] duration:
4.745858802s
FAIL (2025-07-05 20:30:35 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.745886394s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............................XXXX............................] duration:
4.844690525s
FAIL (2025-07-05 20:29:59 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.844717247s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.............................XXXX...........................] duration:
4.808953398s
FAIL (2025-07-05 20:28:57 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.80898568s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..............................XXXX..........................] duration:
4.81411746s
FAIL (2025-07-05 20:28:17 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.814139793s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...............................XXXX.........................] duration:
4.863861619s
FAIL (2025-07-05 20:27:57 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.863884874s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................................XXXX........................] duration:
4.972655334s
FAIL (2025-07-05 20:27:14 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.972680141s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.................................XXXX.......................] duration:
4.871866724s
FAIL (2025-07-05 20:26:23 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.87189058s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..................................XXXX......................] duration:
4.848469422s
FAIL (2025-07-05 20:25:47 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.848498297s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...................................XXXX.....................] duration:
4.825485505s
FAIL (2025-07-05 20:25:25 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.825521142s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....................................XXXX....................] duration:
4.880487327s
FAIL (2025-07-05 20:25:06 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.880563614s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....................................XXXX...................] duration:
4.908251992s
FAIL (2025-07-05 20:24:01 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.908280418s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......................................XXXX..................] duration:
4.844932841s
FAIL (2025-07-05 20:23:03 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.844956685s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......................................XXXX.................] duration:
4.918507236s
FAIL (2025-07-05 20:22:38 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.918533796s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........................................XXXX................] duration:
4.827474258s
FAIL (2025-07-05 20:21:43 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.827502851s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........................................XXXX...............] duration:
4.921087836s
FAIL (2025-07-05 20:20:55 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.92111099s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........................................XXXX..............] duration:
4.867105357s
FAIL (2025-07-05 20:20:37 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.867201731s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........................................XXXX.............] duration:
4.876356729s
FAIL (2025-07-05 20:20:05 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.876380183s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............................................XXXX............] duration:
4.779758531s
FAIL (2025-07-05 20:18:55 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.779795321s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.............................................XXXX...........] duration:
4.82622404s
FAIL (2025-07-05 20:18:10 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.826250179s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..............................................XXXX..........] duration:
4.840494789s
FAIL (2025-07-05 20:17:47 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.840520679s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...............................................XXXX.........] duration:
4.956783808s
FAIL (2025-07-05 20:17:16 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.956810048s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................................................XXXX........] duration:
4.829542699s
FAIL (2025-07-05 20:16:19 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
WVZV23XA, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298498375 (299h0m19.06913971s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.298710351 (299h0m19.069351686s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.299115756 (299h0m19.069757091s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:44.310906534 (299h0m19.081547869s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Uploading piece...
Jul 5 20:10:45.103513286 (299h0m19.874154611s) [upload=239111]: Next returned nil segment
Jul 5 20:10:45.103529107 (299h0m19.874170452s) [upload=239111]: Waiting for error group managing segments...
Jul 5 20:10:45.478553907 (299h0m20.249195242s) [noise=true , address=81.171.14.70:4046 , piece_id=COXL2HXVFCGQ5ZGZ6B4JVNUNYMISWTM5HBWPIKFRKAKJXYOOMPNA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.484237630 (299h0m20.254878965s) [noise=true , address=89.149.201.147:4007 , piece_id=TUGBDNJS6OUR6RM5BP5I4DEYSQYF7PSPC6GPYJMYV3FPYWOCSW4Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.492310805 (299h0m20.26295213s) [noise=true , address=89.149.201.147:4023 , piece_id=H52D3F2GKVIGNQW766EVYSXWPJ5QBEIOU46Y7QJBUNHSPM66I5ZA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.493835722 (299h0m20.264477057s) [noise=true , address=89.149.201.147:4005 , piece_id=YAJVGBPFDTKNFJ2GLX2RP7ICRQSJ36SKI325KCEGRBX67YXF3LYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.495912996 (299h0m20.266554331s) [noise=true , address=89.149.201.147:4014 , piece_id=6XW2AIYMRGIVUBZH53KATZDS2OGLSTH356SFQLOA265ZHKS6X37Q, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.502730138 (299h0m20.273371473s) [noise=true , address=89.149.201.147:4016 , piece_id=A5UBHMNX2AQPSMQYZIFNDBTI6K34JDVWRJCQPJNDDCD7X2GVZJYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503119022 (299h0m20.273760367s) [noise=true , address=81.171.14.70:4048 , piece_id=SK6YGOREANXYQHW56QPTRZNW624MMFCMX53FJN2WXWPYPIUP2OYQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.503236647 (299h0m20.273877982s) [noise=true , address=89.149.201.147:4001 , piece_id=YQ6OOI3KVSN6LAZ7RW5UQFMBEUQOUIADJOEAONZ3PAOSKD3LVXTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.505704838 (299h0m20.276346184s) [noise=true , address=89.149.201.147:4006 , piece_id=X35JER5H4UTE7CD4VQKSZ66ZBGUYFTTUIICOZ5SIQSWNBKTSYS7A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511277009 (299h0m20.281918364s) [noise=true , address=81.171.14.70:4040 , piece_id=HLWGIE6DA5BYJ4WX2JIX6J5I7FUPW2HLOKSNV4G6BVE4GM33VQOQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.511360579 (299h0m20.282001914s) [noise=true , address=81.171.14.70:4047 , piece_id=VZY7BFBK4V7QVS6J2UX76PUK6NJ264XPFTU6Q75JPO6FHBUDKKKQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.515576865 (299h0m20.2862182s) [noise=true , address=81.171.14.70:4034 , piece_id=54KLR4T2GR2T56V4QS5HSYR2E5K5GX6QOXB75MYXP66W4XRBRTKA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.520039964 (299h0m20.290681299s) [noise=true , address=89.149.201.147:4022 , piece_id=2PAUF2KLRD2BC4USB65HJK57OOXFWERKLK6TWXGG6KLF5OGKFWAA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.523617046 (299h0m20.294258382s) [noise=true , address=81.171.14.70:4038 , piece_id=MXA3GFS7BN2MQZPIORJ2Y7WIRMAGEFGT2JZRG5C5JJMXJSISHJRA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.530519312 (299h0m20.301160647s) [noise=true , address=81.171.14.70:4028 , piece_id=O5AMXNA62MWD7QCCVEDYSWSHSMTOHBRUP7L6KAQ6M5GKOZPDI5QQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.537648280 (299h0m20.308289615s) [noise=true , address=81.171.14.70:4033 , piece_id=A2FLBMEQTWQPI6P3UI27435QC4N7STNYTS33JSMACWIRNMB5SQTA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.559157879 (299h0m20.329799214s) [noise=true , address=89.149.201.147:4015 , piece_id=K3D5YGP5MUSBLM4KOTP5RPRLMH6MMQEXAC2KGY3QVST55OHV6OBQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:10:45.572138773 (299h0m20.342780098s) [noise=true , address=81.171.14.70:4025 , piece_id=X3DEOQ7DM4SNSFO6VILDMNBKXQ6AV5JP54TNMQYGPD4FW6VWBBRQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: <nil>
Jul 5 20:11:43.477500958 (299h1m18.248142293s) [noise=true , address=185.167.204.205:4031 , piece_id=JEYRB3WBVKB2G2B5KIJ3WOB236EDC4MNAFPHAZEYBLFFJXNC76WQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: rpc: dial tcp 185.167.204.205:4031: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477572796 (299h1m18.248214131s) [noise=true , address=185.167.204.206:4058 , piece_id=ABIQH2XLVZTRWYV3PPPKMJCF67RYYR4H3SRZNU7V3YT3XV4CBVYA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12cJjosS5PjPTn1t4TF4Xw7sL6c2kofhJyiLtitrnDy9V2PZFM7, address:185.167.204.206:4058): protocol: rpc: dial tcp 185.167.204.206:4058: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477594056 (299h1m18.248235401s) [noise=true , address=185.167.204.205:4010 , piece_id=ETMCHV4YJL7MN2EX6Y6B6ZBHMXOPJ2QYZSXXVFQQC27OYP7F3SVQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV, address:185.167.204.205:4010): protocol: rpc: dial tcp 185.167.204.205:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477633242 (299h1m18.248274577s) [noise=true , address=185.167.204.206:4061 , piece_id=BRHOQ6JH3RESNWWTBRMLZU5RNHMNR4MUQJPI6UO2SXFAONZOHCBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: rpc: dial tcp 185.167.204.206:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477664171 (299h1m18.248305506s) [noise=true , address=185.167.204.206:4059 , piece_id=GG3SW5S7L6QT5FXPDDLAFEVAQIJ2D257ZXAL52EN5C6W42DUEEBA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: rpc: dial tcp 185.167.204.206:4059: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477692344 (299h1m18.24833368s) [noise=true , address=185.167.204.206:4053 , piece_id=S4JSQP7VYXY4OR5FLJ36VKGVY5STNW7E7QS2T7Z3UI2BWVZV23XA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8, address:185.167.204.206:4053): protocol: rpc: dial tcp 185.167.204.206:4053: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477719446 (299h1m18.248360781s) [noise=true , address=185.167.204.205:4013 , piece_id=F6QXHDXAJMZUHNYJDEYJBBABVPICDQZYHOWT4V4VUU2KDVJLLMDQ, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477748422 (299h1m18.248389757s) [noise=true , address=185.167.204.205:4009 , piece_id=N7KED75S2BODCYLHWTLTGMSZRCP2UEL32FGT2JKC2FCQ262POEOA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:47104->185.167.204.205:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477777137 (299h1m18.248418482s) [noise=true , address=185.167.204.205:4032 , piece_id=FVZVMZAU77PLD3WBRE2EUAIKR7SI7LHK7WXX34JP5HXQI6L5WWXA, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477865165 (299h1m18.2485065s) [noise=true , address=185.167.204.206:4043 , piece_id=PV2JIS3YCHH46V4ZHPTTZERAIGIY7UBMBFQJMHIYY4Z5EC5X337A, seg_pos={0 0}, upload=239111]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 188.166.225.170:34048->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:11:43.477895543 (299h1m18.248536888s) [seg_pos={0 0}, upload=239111]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jul 5 20:11:43.654320962 (299h1m18.424962297s) [upload=239111]: Done uploading segments...
Jul 5 20:11:43.654349998 (299h1m18.424991333s) [upload=239111]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.829559572s
core
uplink
eu-select-1
eu1-placement-15
|