Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.............X........] duration: 2.099673935s FAIL (2025-07-31 08:08:50 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 2.099700554s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.012267586s FAIL (2025-07-31 08:08:45 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 5.01229635s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X..X.................X.............................X.....X.] duration: 5.914190664s FAIL (2025-07-31 08:08:36 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.914212314s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.............X.......] duration: 1.869435388s FAIL (2025-07-31 08:08:28 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.869503218s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X..X.................X.............................X.....X] duration: 3.972726417s FAIL (2025-07-31 08:08:02 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 3.972748158s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.096016666s FAIL (2025-07-31 08:07:48 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 6.096043417s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.............X......] duration: 3.930135465s FAIL (2025-07-31 08:07:17 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 3.930159842s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X..X.................X.............................X.....] duration: 5.803868826s FAIL (2025-07-31 08:07:06 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.803900737s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.583470146s FAIL (2025-07-31 08:06:44 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 5.583493912s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.............X.....] duration: 1.816132661s FAIL (2025-07-31 08:06:42 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.816158021s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X..X.................X.............................X....] duration: 5.556992847s FAIL (2025-07-31 08:06:30 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.557023023s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.............X....] duration: 1.866597409s FAIL (2025-07-31 08:05:39 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.866616897s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X..X.................X.............................X...] duration: 5.978947407s FAIL (2025-07-31 08:05:36 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.978968147s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.564366646s FAIL (2025-07-31 08:05:33 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 6.56439552s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.............X...] duration: 1.917850944s FAIL (2025-07-31 08:05:02 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.917878648s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X..X.................X.............................X..] duration: 5.769130886s FAIL (2025-07-31 08:05:01 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.769239372s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X..X.................X.............................X.] duration: 5.623804049s FAIL (2025-07-31 08:04:44 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 5.623830329s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.020145238s FAIL (2025-07-31 08:04:28 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 5.020168132s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.............X..] duration: 1.87120827s FAIL (2025-07-31 08:04:22 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.87123423s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X..X.................X.............................X] duration: 4.102812206s FAIL (2025-07-31 08:04:07 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/4M") Duration: 4.102839869s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.............X.] duration: 1.846285025s FAIL (2025-07-31 08:03:28 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.846312939s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 4.881128281s FAIL (2025-07-31 08:03:25 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 4.881163339s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X..X.................X.............................] duration: 5.63617442s FAIL (2025-07-31 08:03:11 UTC) orbiter warning: Operation: sync2.Copy uplink: invalid range 0:4194304 (size:4194304) Duration: 5.636208394s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 4.939080506s FAIL (2025-07-31 08:02:34 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 4.939104332s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X............................................X.............X] duration: 1.415133802s FAIL (2025-07-31 08:02:17 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K Duration: 1.415162508s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X..X.................X............................] duration: 5.836134722s FAIL (2025-07-31 08:02:04 UTC) orbiter warning: Operation: sync2.Copy uplink: invalid range 0:4194304 (size:4194304) Duration: 5.836161652s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X............................................X.............] duration: 1.940940311s FAIL (2025-07-31 08:02:01 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.940978204s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.803552031s FAIL (2025-07-31 08:01:31 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 5.803580825s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X............................................X............] duration: 1.874848366s FAIL (2025-07-31 08:01:04 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.874875607s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X..X.................X...........................] duration: 5.957082935s FAIL (2025-07-31 08:00:50 UTC) orbiter warning: Operation: sync2.Copy uplink: invalid range 0:4194304 (size:4194304) Duration: 5.957110539s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.034492971s FAIL (2025-07-31 08:00:37 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 5.034519543s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X............................................X...........] duration: 1.885301496s FAIL (2025-07-31 08:00:26 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.885331583s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X..X.................X..........................] duration: 5.710003918s FAIL (2025-07-31 07:59:49 UTC) orbiter warning: Operation: sync2.Copy uplink: invalid range 0:4194304 (size:4194304) Duration: 5.710030829s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.017968141s FAIL (2025-07-31 07:59:37 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 5.017993118s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X............................................X..........] duration: 1.826235593s FAIL (2025-07-31 07:59:13 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.82628142s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X..X.................X.........................] duration: 5.570562118s FAIL (2025-07-31 07:59:05 UTC) orbiter warning: Operation: sync2.Copy uplink: invalid range 0:4194304 (size:4194304) Duration: 5.570585493s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.550953571s FAIL (2025-07-31 07:58:23 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 5.550984781s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X............................................X.........] duration: 1.967609659s FAIL (2025-07-31 07:58:15 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.967639156s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X..X.................X........................] duration: 5.829318156s FAIL (2025-07-31 07:58:14 UTC) orbiter warning: Operation: sync2.Copy uplink: invalid range 0:4194304 (size:4194304) Duration: 5.829343926s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X............................................X........] duration: 1.834974304s FAIL (2025-07-31 07:57:49 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.834997959s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.552567891s FAIL (2025-07-31 07:57:37 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 5.552587538s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X..X.................X.......................] duration: 5.656593336s FAIL (2025-07-31 07:57:30 UTC) orbiter warning: Operation: sync2.Copy uplink: invalid range 0:4194304 (size:4194304) Duration: 5.656625858s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X............................................X.......] duration: 1.843960164s FAIL (2025-07-31 07:57:19 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.843985051s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.002038712s FAIL (2025-07-31 07:56:53 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 5.002067317s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X............................................X......] duration: 1.879992282s FAIL (2025-07-31 07:56:49 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.880047157s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 4.874107431s FAIL (2025-07-31 07:56:36 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 4.874139862s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X..X.................X......................] duration: 5.748899016s FAIL (2025-07-31 07:56:16 UTC) orbiter warning: Operation: sync2.Copy uplink: invalid range 0:4194304 (size:4194304) Duration: 5.748925426s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X............................................X.....] duration: 1.877158756s FAIL (2025-07-31 07:56:09 UTC) orbiter warning: Operation: DownloadObject uplink: object not found ("orbiter_us_0/1K") Duration: 1.877197238s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 4.949671229s FAIL (2025-07-31 07:55:52 UTC) orbiter warning: Operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== :4041 , piece_id=4TOBZ4RCPXIT2NMXYWFCUOMEOQLPMVBRHMXVQ6OJDYCRHGZPDSRQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.360954037 (13h53m18.298612537s) [noise=true , address=89.149.201.147:4017 , piece_id=SLRL3M6ESSUJH4QJF5KHANYO23UIKQCJHWSJ3ZGGM7K65CWB3CDQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.363716784 (13h53m18.301375283s) [noise=true , address=89.149.201.147:4021 , piece_id=RJNTJZZUC42EQTLG5BJO5SWCCQ7Z53YSUDCG5RHN3ADWQ3PNOREA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.364452280 (13h53m18.302110779s) [noise=true , address=89.149.201.147:4022 , piece_id=QV6PLLEYRPVAVXCKCTJJV4EFFK5OFVGFAO5UFBCSOWZ4RU34QTBQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.366746490 (13h53m18.30440499s) [noise=true , address=81.171.14.70:4047 , piece_id=ID5RSNMKWB5MGKLAQVZ3FLX7I4STJWV2DQ3TYKL64TLMFC5DIZPQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.367408457 (13h53m18.305066956s) [noise=true , address=81.171.14.70:4045 , piece_id=TEYKJIMPN33ITZJBBYNWVK3LX3IH6LW5SSTABUS4HL2RAVGS2SQQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.372749175 (13h53m18.310407674s) [noise=true , address=89.149.201.147:4013 , piece_id=SJR3FB7M6GWJOM3HQ5TXYGGPZ7TVWZG4U2WBEISEKMXRFBTPYTBA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.374657567 (13h53m18.312316076s) [noise=true , address=89.149.201.147:4015 , piece_id=NLA7BDDRIG6BSPR73OR2546ANBFNBKK3KRMQED5YQYQ44PITY2HA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.377442225 (13h53m18.315100724s) [noise=true , address=81.171.14.70:4040 , piece_id=4QVPLHYMIJ4TQMYFXCQBMIVEJKSKAZX3US2RSUTDN5XHYASPEMWQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379210779 (13h53m18.316869278s) [noise=true , address=81.171.14.70:4034 , piece_id=GB7U3E4IDKVU4EK7KUROHY6WYQYP2DBCUOM6WSK43BGDEO6XN6LQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.379742186 (13h53m18.317400685s) [noise=true , address=89.149.201.147:4012 , piece_id=QYIRQVPDR6XMDWW6CUTD3ZTPLVVXF5CHRT75GOFFUWPKW5DEO2IA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.380383443 (13h53m18.318041942s) [noise=true , address=81.171.14.70:4033 , piece_id=KR6SVORADHZ2MYTNGPWNU3EVC7APZCH6B2HAE2OMGW3LGPCQDQFA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382104987 (13h53m18.319763486s) [noise=true , address=89.149.201.147:4024 , piece_id=5GCOSLG6L6BCW7ZUEDFOMZ6ZYO7XQGGUN6J72VU4EFWVUDRLXU3Q, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.382973318 (13h53m18.320631817s) [noise=true , address=81.171.14.70:4029 , piece_id=P66RCMJTQ4INXPSSRIMSIXO4AANJCHZ7HHUTVRIBVBEFBMFMOGYA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.389233987 (13h53m18.326892486s) [noise=true , address=81.171.14.70:4026 , piece_id=C3KI7VEBII5OUW3SVZ25XSIZOCC7N3EYHJLGBTVZKC2RWFOTI5VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392230651 (13h53m18.32988915s) [noise=true , address=81.171.14.70:4043 , piece_id=RAM2YQAKAWEGTUC35KWTA7SRZROBCXS2QHMXDNUCMTQFTRCF7XUA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:50:28.392579929 (13h53m18.330238428s) [noise=true , address=81.171.14.70:4037 , piece_id=7BD4S6F6ATPZRNRNWRAIE7T2R436JQXIWB4KJLM3ZF5F7PLB4GJA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: <nil> Jul 31 07:51:26.338459026 (13h54m16.276117976s) [noise=true , address=185.167.204.206:4057 , piece_id=RSEBXXPDST27TOP2JPVEH5SSUR7LTYBIMBXJOEFBW2GXPS5AR7YQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338552625 (13h54m16.276211124s) [noise=true , address=185.167.204.206:4067 , piece_id=URM5MRXOTX67D6RUGQQG7RV6ZBH7LEV5HVJNLKE6LHZNUUHT2JOA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338587011 (13h54m16.27624551s) [noise=true , address=185.167.204.206:4071 , piece_id=RJPTJOIYZKUQLKNF3XPE6SXSIPXNRGA2MTN7OYIRFLAA72PFMZ6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34150->185.167.204.206:4071: use of closed network connection Jul 31 07:51:26.338625304 (13h54m16.276283804s) [noise=true , address=185.167.204.205:4001 , piece_id=OXMN3HLITSTRAC2VZ7EWS237HVTWBCEXGZH7A6UUK66SYZANCKMQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53152->185.167.204.205:4001: use of closed network connection Jul 31 07:51:26.338629643 (13h54m16.276288142s) [noise=true , address=185.167.204.205:4027 , piece_id=X53P4S5CPPYRPFYMNVYLXBFUTBCXDSUOGUYUHIYPCHOWZUUB2R6A, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338662054 (13h54m16.276320554s) [noise=true , address=185.167.204.206:4059 , piece_id=4HVCGCMYD3YEJSIXVAKZRLVHETHYUFJYDOFS3QIL4FPSU2OG52WA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48448->185.167.204.206:4059: use of closed network connection Jul 31 07:51:26.338670701 (13h54m16.2763292s) [noise=true , address=185.167.204.206:4043 , piece_id=A5P2HWPQPKVF7FMQTYKEB4PQM4LSP6H2GHEIW2YZTY4I64CSTQGA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF Jul 31 07:51:26.338696861 (13h54m16.27635536s) [noise=true , address=185.167.204.206:4051 , piece_id=OKIA4R6LDGESE4BYVGWNH3VRNSUZ47G4GHJ4YKFJHYQWXMWZM4VQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12hK2MSVcFNaCVp7k4krUva7jXEJYhjnHPxPrMgq87jcDXJPkv2, address:185.167.204.206:4051): protocol: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:32878->185.167.204.206:4051: use of closed network connection Jul 31 07:51:26.338731708 (13h54m16.276390207s) [noise=true , address=185.167.204.206:4049 , piece_id=QZNUPVU3FHKDZCHRAMFDRMQAHLME7NDLIKRAX46VK2QBUGUCQHDA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58232->185.167.204.206:4049: use of closed network connection Jul 31 07:51:26.338735836 (13h54m16.276394335s) [noise=true , address=185.167.204.205:4009 , piece_id=TJD6X3WZXEKCCWDRNPNQQBYHVAQ2LYHVNWU3LUMHJA346DPIOZHA, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54950->185.167.204.205:4009: use of closed network connection Jul 31 07:51:26.338773397 (13h54m16.276431897s) [noise=true , address=185.167.204.206:4041 , piece_id=NN467GKNZOQESMERSKWAUNR74IX5B7BPJU7CPR7HYGTSPWEXPYLQ, seg_pos={0 0}, upload=13308]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46116->185.167.204.206:4041: use of closed network connection Jul 31 07:51:26.338791052 (13h54m16.276449551s) [seg_pos={0 0}, upload=13308]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Jul 31 07:51:26.515116997 (13h54m16.452775486s) [upload=13308]: Done uploading segments... Jul 31 07:51:26.515145552 (13h54m16.452804051s) [upload=13308]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 4.949700315s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X..X.................X.....................] duration: 6.195582362s FAIL (2025-07-31 07:55:49 UTC) orbiter warning: Operation: sync2.Copy uplink: invalid range 0:4194304 (size:4194304) Duration: 6.195608722s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)