Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.020808722s FAIL (2025-07-31 11:28:02 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 6.020836364s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.060867791s FAIL (2025-07-31 11:27:51 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 2.060890875s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.694865443s FAIL (2025-07-31 11:27:30 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 5.6948905s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 1.844494775s FAIL (2025-07-31 11:27:28 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.844518261s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.888694265s FAIL (2025-07-31 11:27:07 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 5.888722891s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X................X.......................................] duration: 5.826402698s FAIL (2025-07-31 11:26:57 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.826429919s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 1.855590273s FAIL (2025-07-31 11:26:33 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.855612345s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.07789789s FAIL (2025-07-31 11:26:23 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 6.077926897s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 1.848424609s FAIL (2025-07-31 11:26:14 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.84845121s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X................X......................................] duration: 5.801472421s FAIL (2025-07-31 11:26:04 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.801503791s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 1.839874697s FAIL (2025-07-31 11:25:24 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.839903913s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X................X.....................................] duration: 5.610416875s FAIL (2025-07-31 11:25:13 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.610454188s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 7.166923552s FAIL (2025-07-31 11:25:10 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 7.166945334s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.996173373s FAIL (2025-07-31 11:24:20 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.996206747s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.91390823s FAIL (2025-07-31 11:24:19 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 5.913934229s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X................X....................................] duration: 5.798273758s FAIL (2025-07-31 11:24:16 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.798311511s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X................X...................................] duration: 5.611356944s FAIL (2025-07-31 11:23:35 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.611380869s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.985413277s FAIL (2025-07-31 11:23:15 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.985437794s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.993543528s FAIL (2025-07-31 11:23:14 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 5.993578004s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X................X..................................] duration: 5.648893094s FAIL (2025-07-31 11:22:30 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.648921989s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.843769498s FAIL (2025-07-31 11:22:23 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.843797551s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.881581287s FAIL (2025-07-31 11:22:22 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 5.881608939s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X................X.................................] duration: 5.758230826s FAIL (2025-07-31 11:21:55 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.758255784s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.810476523s FAIL (2025-07-31 11:21:54 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.810504347s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.740595581s FAIL (2025-07-31 11:21:13 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 5.740623865s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.858612357s FAIL (2025-07-31 11:20:59 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.858632876s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X................X................................] duration: 5.670836952s FAIL (2025-07-31 11:20:55 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.670865077s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.883757307s FAIL (2025-07-31 11:20:32 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.883782998s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.139782064s FAIL (2025-07-31 11:20:27 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 6.139807822s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X................X...............................] duration: 5.923038981s FAIL (2025-07-31 11:20:01 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.923068046s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X................X..............................] duration: 5.668432729s FAIL (2025-07-31 11:19:37 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.668462616s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.665600159s FAIL (2025-07-31 11:19:29 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 5.665627231s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.074666067s FAIL (2025-07-31 11:19:26 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 2.074688811s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X................X.............................] duration: 5.847172745s FAIL (2025-07-31 11:19:18 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.847204355s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.835384511s FAIL (2025-07-31 11:19:04 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.835413276s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X................X............................] duration: 5.705459447s FAIL (2025-07-31 11:18:37 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.705488013s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.094723278s FAIL (2025-07-31 11:18:22 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 6.094751762s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.854284275s FAIL (2025-07-31 11:18:13 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.854304945s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X................X...........................] duration: 5.697532938s FAIL (2025-07-31 11:17:47 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.697563055s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.932774107s FAIL (2025-07-31 11:17:36 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 5.932797491s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.869428543s FAIL (2025-07-31 11:17:08 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.869465204s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.99966845s FAIL (2025-07-31 11:16:51 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 1.999701474s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X................X..........................] duration: 5.812609085s FAIL (2025-07-31 11:16:48 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.81263771s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.841743531s FAIL (2025-07-31 11:16:47 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 5.841781323s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X................X.........................] duration: 5.873231278s FAIL (2025-07-31 11:16:10 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.873254701s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.062691407s FAIL (2025-07-31 11:16:00 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 2.06271948s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.829650922s FAIL (2025-07-31 11:15:46 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 5.829676459s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.033571529s FAIL (2025-07-31 11:15:37 UTC) orbiter warning: Operation: Commit uplink: too many requests Duration: 2.033600714s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X................X........................] duration: 5.847024546s FAIL (2025-07-31 11:15:17 UTC) orbiter warning: Operation: ListObjects unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M Duration: 5.84705233s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.776357621s FAIL (2025-07-31 11:15:01 UTC) orbiter warning: Operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer ======LOGS====== s={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706001187 (17h12m29.643659676s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706058216 (17h12m29.643716705s) [seg_pos={0 0}, upload=16512]: Done begin upload segment. Jul 31 11:09:39.706268369 (17h12m29.643926858s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.706575216 (17h12m29.644233715s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707086825 (17h12m29.644745314s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707374805 (17h12m29.645033305s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707624994 (17h12m29.645283493s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.707869532 (17h12m29.645528031s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708144588 (17h12m29.645803087s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708393234 (17h12m29.646051733s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708617603 (17h12m29.646276102s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708860508 (17h12m29.646519007s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.708991329 (17h12m29.646649828s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709192142 (17h12m29.646850632s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709401413 (17h12m29.647059912s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709580676 (17h12m29.647239175s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:39.709776321 (17h12m29.64743482s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Uploading piece... Jul 31 11:09:41.200553881 (17h12m31.13821238s) [upload=16512]: Next returned nil segment Jul 31 11:09:41.200573118 (17h12m31.138231617s) [upload=16512]: Waiting for error group managing segments... Jul 31 11:09:41.619340478 (17h12m31.556998967s) [noise=true , address=104.36.82.21:4507 , piece_id=2LIQLCWKH65OS2F2WFBL77FE4VRWHVLV27O46Y6XSKLG4762VHRQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.620393543 (17h12m31.558052042s) [noise=true , address=104.36.82.52:4118 , piece_id=NVAL3T7QXUQ6AZWFXHCDIOPQA6LTB4E3GDNSJBE7IGTYPE2X3URA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.623725969 (17h12m31.561384468s) [noise=true , address=104.36.82.49:4990 , piece_id=HNJLTLP65IBSUBYHNXRQO5IFUKBUQKNS77VXDLKICNIVV65Z5DWA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.641995596 (17h12m31.579654085s) [noise=true , address=104.36.82.55:4194 , piece_id=23LCPZMUU2YJZ3P6NS5W537S6ZIOGWHQ2VZ6ZCHXMCMLEONPI6WA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.666578151 (17h12m31.60423668s) [noise=true , address=104.36.82.16:4328 , piece_id=JG7P2EHS6W6THL4UYLANHXFHG767TBPLIWP6QJC7RPB56IJC4SOA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.694537518 (17h12m31.632196007s) [noise=true , address=104.36.82.13:4205 , piece_id=LBZ7ZFYJ7JCQEDZLUXO2CWIFICLAC6M4JU5I2IPH2XULL7NZPGVA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.698896088 (17h12m31.636554587s) [noise=true , address=104.36.82.61:4381 , piece_id=N6OLM7TQNJ5NY247QESVQWXTFVE3LCLR3IZG7JICGJDSAPAWIJ2A, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.699196152 (17h12m31.636854651s) [noise=true , address=104.36.82.62:4427 , piece_id=XE2L7NWOADHNUL2Y6IC7IGGCE5LKHSGK6YDE7S6IQDPHJ6IK6JWQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.703647669 (17h12m31.641306168s) [noise=true , address=104.36.82.53:4146 , piece_id=4NV56A5IG3OTU2YICOXWFSH5O2HUCMUEDAMJ3YNH2PSJNBZQNQOQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.707507765 (17h12m31.645166264s) [noise=true , address=104.36.82.12:4169 , piece_id=3JIYRA2CYW6N2XOAZFYTCSHOLYW3D5WLBJYELC6VGL5YOD3XMWSA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.713127127 (17h12m31.650785616s) [noise=true , address=104.36.82.38:4721 , piece_id=XXU56PTQKCPUH3MQGYGLOPPZA4PGNWYKVN3OZUSYVQTH5SA32D3Q, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.734749329 (17h12m31.672407828s) [noise=true , address=104.36.82.56:4260 , piece_id=F4AMUCBXKRHW5TAIYQ6XJDZIIQ2FDQXR6SHXQY55HBRIEJORKPMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.770207694 (17h12m31.707866203s) [noise=true , address=104.36.82.14:4246 , piece_id=PF4RSN5FWBZ6AVP3RWWIPY4RGBJW4627NPHULQ3KCJWTC6GHXTMQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776949073 (17h12m31.714607572s) [noise=true , address=104.36.82.9:4012 , piece_id=FJDMWGM6BPWYPQSWRGSTQMRUIA53T3X74TIZ6QYFTUIELWR7EESQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: <nil> Jul 31 11:09:41.776977367 (17h12m31.714635856s) [seg_pos={0 0}, upload=16512]: Segment reached optimal threshold of 14 pieces. Jul 31 11:09:41.777118096 (17h12m31.714776595s) [noise=true , address=104.36.82.54:4174 , piece_id=BXWWDOZ6VX3FMI5ALFGZTY3T2OSJ2SN2K4CJK3LLNRITC55GO5XQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1293SNDGTKNrYrKDuB5p2VpHWo7ANpQsVKVGa97jXVaGP83Pw51): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777128766 (17h12m31.714787265s) [noise=true , address=104.36.82.11:4138 , piece_id=MHPX5BVCSZTQIHLSKPCEF6A3TQFLXG7GKCNNDQKZ3MESAWHTORFQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777203610 (17h12m31.714862109s) [noise=true , address=104.36.82.46:4510 , piece_id=JYIYL7NYM57KXTKSUNOSTHW7PMUMNO3ER6PRVBDRHL3JASO753EA, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c6o4CCFBx5xgnmaivGFzRGqqp8qrqwyzwTrcpwDYFh71wRQSZ): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777255078 (17h12m31.714913577s) [noise=true , address=104.36.82.11:4147 , piece_id=Y3F5GLUYMBDMECBC5F5GVI2AGUMTOOOCOZ2TEGGBLNUSVODTZXJQ, seg_pos={0 0}, upload=16512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nNFCM4wDSvGMeqF8MF6csgKDUV6QyozoC5fZwUaj7MN1Woz4P): protocol: expected piece hash; context canceled; EOF Jul 31 11:09:41.777272843 (17h12m31.714931342s) [seg_pos={0 0}, upload=16512]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 31 11:09:41.777341293 (17h12m31.714999792s) [upload=16512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 31 11:09:41.777344990 (17h12m31.715003479s) [upload=16512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 31 11:09:42.064358215 (17h12m32.002016704s) [upload=16512]: Done uploading segments... Jul 31 11:09:42.064376300 (17h12m32.002034799s) [upload=16512]: Upload finished. err: <nil> Jul 31 11:10:51.395585706 (17h13m41.333244205s) [upload=16536]: Starting upload Jul 31 11:10:51.395663915 (17h13m41.333322454s) [upload=16536]: Done starting upload Jul 31 11:10:51.395751654 (17h13m41.333410153s) [upload=16536]: Uploading segments... Jul 31 11:10:51.395932419 (17h13m41.333590918s) [upload=16536]: Got next segment. Inline: false Jul 31 11:10:51.395969501 (17h13m41.333628s) [upload=16536]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 31 11:10:51.395974009 (17h13m41.333632508s) [upload=16536]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 31 11:11:06.865897794 (17h13m56.803556293s) [upload=16536]: Next segment err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Jul 31 11:11:06.865931318 (17h13m56.803589817s) [upload=16536]: Done uploading segments... Jul 31 11:11:06.865944704 (17h13m56.803603203s) [upload=16536]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:55762->34.150.199.48:7777: read: connection reset by peer Duration: 5.776376447s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)