Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.............X.................X.....] duration:
1.820581846s
FAIL (2025-07-31 08:19:56 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.820612032s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......X.............................X.....X............XX...] duration:
5.676813672s
FAIL (2025-07-31 08:19:54 UTC)
orbiter warning: Operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 7722db08c632d0b77d6a2cf33c88a45481a859049bde9d0bd48b256d337ace9d != before 97da0a7176e64d019c76c44e503770db5f42523790778397e3ded4780a832b9b
Duration: 5.67683854s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.............X.................X....] duration:
2.038102172s
FAIL (2025-07-31 08:19:35 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 2.038127982s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.419152111s
FAIL (2025-07-31 08:19:24 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.419177058s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......X.............................X.....X............XX..] duration:
5.890233886s
FAIL (2025-07-31 08:18:41 UTC)
orbiter warning: Operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 7722db08c632d0b77d6a2cf33c88a45481a859049bde9d0bd48b256d337ace9d != before 97da0a7176e64d019c76c44e503770db5f42523790778397e3ded4780a832b9b
Duration: 5.8902623s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X.............X.................X...] duration:
1.821443507s
FAIL (2025-07-31 08:18:23 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.821468375s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
5.556665099s
FAIL (2025-07-31 08:18:21 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.556688996s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........X.............................X.....X............XX.] duration:
5.765635963s
FAIL (2025-07-31 08:18:17 UTC)
orbiter warning: Operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 7722db08c632d0b77d6a2cf33c88a45481a859049bde9d0bd48b256d337ace9d != before 97da0a7176e64d019c76c44e503770db5f42523790778397e3ded4780a832b9b
Duration: 5.765666682s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.288057397s
FAIL (2025-07-31 08:17:51 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 6.288088706s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........X.............................X.....X............XX] duration:
5.736928697s
FAIL (2025-07-31 08:17:37 UTC)
orbiter warning: Operation: sync2.Copy digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 7722db08c632d0b77d6a2cf33c88a45481a859049bde9d0bd48b256d337ace9d != before 97da0a7176e64d019c76c44e503770db5f42523790778397e3ded4780a832b9b
Duration: 5.736948947s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.094907232s
FAIL (2025-07-31 08:17:32 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.094969221s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.............X.................X..] duration:
1.836155834s
FAIL (2025-07-31 08:17:11 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.836183236s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X.............................X.....X............X] duration:
874.512186ms
FAIL (2025-07-31 08:17:09 UTC)
orbiter warning: Operation: sync2.Copy uplink: too many requests
Duration: 874.532613ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
6.087987382s
FAIL (2025-07-31 08:17:09 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 6.088003574s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................X.............X.................X.] duration:
1.96140322s
FAIL (2025-07-31 08:16:46 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.961432746s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................X.............X.................X] duration:
1.585884314s
FAIL (2025-07-31 08:16:16 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.585914391s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.............................X.....X............] duration:
5.819192639s
FAIL (2025-07-31 08:16:15 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.819221526s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.............X.................] duration:
1.823411198s
FAIL (2025-07-31 08:15:59 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.823445676s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
4.965676605s
FAIL (2025-07-31 08:15:58 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 4.965707855s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.............................X.....X...........] duration:
5.559922386s
FAIL (2025-07-31 08:15:50 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.559950428s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
4.91085935s
FAIL (2025-07-31 08:15:36 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 4.910894358s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.............X................] duration:
1.866693937s
FAIL (2025-07-31 08:15:29 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.866728393s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.037342648s
FAIL (2025-07-31 08:15:19 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.03736876s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.408611521s
FAIL (2025-07-31 08:14:58 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.408644063s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.............................X.....X..........] duration:
5.82491844s
FAIL (2025-07-31 08:14:56 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.824946915s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.............................X.....X.........] duration:
5.613846233s
FAIL (2025-07-31 08:14:39 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.613863385s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
6.052864679s
FAIL (2025-07-31 08:14:32 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 6.05291211s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.............X...............] duration:
1.846698757s
FAIL (2025-07-31 08:14:23 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.846742941s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.............................X.....X........] duration:
5.828211905s
FAIL (2025-07-31 08:13:59 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.828241432s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.............X..............] duration:
1.8221902s
FAIL (2025-07-31 08:13:54 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.822219284s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
4.991215356s
FAIL (2025-07-31 08:13:39 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 4.991240082s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.............................X.....X.......] duration:
5.995128821s
FAIL (2025-07-31 08:13:22 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.995154972s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
5.288093658s
FAIL (2025-07-31 08:13:20 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.288116913s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X.............X.............] duration:
1.860187323s
FAIL (2025-07-31 08:13:06 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.860215035s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.............X............] duration:
1.818868659s
FAIL (2025-07-31 08:12:32 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.818896781s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.............................X.....X......] duration:
5.520882816s
FAIL (2025-07-31 08:12:19 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.52091146s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.648240896s
FAIL (2025-07-31 08:12:07 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.648273558s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
4.952103722s
FAIL (2025-07-31 08:11:41 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 4.952130443s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.............X...........] duration:
1.824984857s
FAIL (2025-07-31 08:11:29 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.825013183s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.................X.............................X.....X.....] duration:
5.610647656s
FAIL (2025-07-31 08:11:23 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.610671201s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.026288373s
FAIL (2025-07-31 08:11:15 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.026324811s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.................X.............................X.....X....] duration:
5.875440936s
FAIL (2025-07-31 08:10:59 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.875465072s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.............X..........] duration:
1.842554364s
FAIL (2025-07-31 08:10:57 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.842573492s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.................X.............................X.....X...] duration:
5.676780983s
FAIL (2025-07-31 08:10:21 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.6768009s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.271179976s
FAIL (2025-07-31 08:10:10 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.271208621s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.............X.........] duration:
1.86447606s
FAIL (2025-07-31 08:09:53 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
Duration: 1.864501308s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
6.32154935s
FAIL (2025-07-31 08:09:47 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 6.321577103s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X..X.................X.............................X.....X..] duration:
5.630928251s
FAIL (2025-07-31 08:09:44 UTC)
orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
Duration: 5.630951665s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
4.868841184s
FAIL (2025-07-31 08:09:28 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 4.868866353s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.535383768s
FAIL (2025-07-31 08:09:04 UTC)
orbiter warning:
Operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 17)
======LOGS======
:4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil>
Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection
Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection
Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection
Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection
Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection
Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection
Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection
Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil>
Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments...
Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17)
Duration: 5.535410398s
core
uplink
eu-select-1
eu1-placement-15
|