Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [......................X......X..X........X..X......XX.......] duration: 6.151446525s FAIL (2025-08-08 20:04:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 20:00:07.141148811 (2h34m1.572228952s) [upload=2718]: Starting upload Aug 8 20:00:07.141280754 (2h34m1.572360895s) [upload=2718]: Done starting upload Aug 8 20:00:07.141422014 (2h34m1.572502155s) [upload=2718]: Uploading segments... Aug 8 20:00:07.141595335 (2h34m1.572675477s) [upload=2718]: Got next segment. Inline: false Aug 8 20:00:07.141741656 (2h34m1.572821797s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 20:00:07.141749080 (2h34m1.572829221s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 20:00:07.595746990 (2h34m2.026827141s) [seg_pos={0 0}, upload=2718]: Begin upload segment... Aug 8 20:00:07.595861239 (2h34m2.02694137s) [seg_pos={0 0}, upload=2718]: Done begin upload segment. Aug 8 20:00:07.595922787 (2h34m2.027002918s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.595956251 (2h34m2.027036392s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596715754 (2h34m2.027795885s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596805866 (2h34m2.027885997s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597192105 (2h34m2.028272236s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597391477 (2h34m2.028471608s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597651324 (2h34m2.028731465s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597726848 (2h34m2.028806979s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598206957 (2h34m2.029287088s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598522330 (2h34m2.029602471s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598908479 (2h34m2.02998861s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599216689 (2h34m2.03029683s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599392606 (2h34m2.030472747s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599537142 (2h34m2.030617283s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599824923 (2h34m2.030905054s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600136819 (2h34m2.03121695s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600480467 (2h34m2.031560598s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.602971984 (2h34m2.034052125s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:08.728685362 (2h34m3.159765494s) [upload=2718]: Next returned nil segment Aug 8 20:00:08.728709328 (2h34m3.15978947s) [upload=2718]: Waiting for error group managing segments... Aug 8 20:00:09.077117596 (2h34m3.508197727s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.217534363 (2h34m3.648614495s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.450976516 (2h34m3.882056647s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.458071331 (2h34m3.889151462s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549367257 (2h34m3.980447388s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549680576 (2h34m3.980760717s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.585281862 (2h34m4.016361993s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.591562939 (2h34m4.02264307s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629338826 (2h34m4.060418957s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629644681 (2h34m4.060724812s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.642784231 (2h34m4.073864362s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.653643208 (2h34m4.084723339s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662115969 (2h34m4.0931961s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662332091 (2h34m4.093412222s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662358973 (2h34m4.093439104s) [seg_pos={0 0}, upload=2718]: Segment reached optimal threshold of 14 pieces. Aug 8 20:00:09.662507337 (2h34m4.093587468s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBuWLogtN8mv4nwXDpzGdQtbKDz1EfVENSjXC54QdFp2fJg99): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662578122 (2h34m4.093658253s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YU8onCrXzQdzfNwpsiVT6tep4oUrKtazu7Cg9f8atWJoKrXyC): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662633248 (2h34m4.093713379s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662649890 (2h34m4.093730021s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v4QJpSy7hk4pShMu3FswnZAf3rzyCNUx5sUZSPSvxpecY8T9X): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662663306 (2h34m4.093743437s) [seg_pos={0 0}, upload=2718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 20:00:09.662759469 (2h34m4.093839611s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 20:00:09.662765972 (2h34m4.093846133s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 20:00:09.962328854 (2h34m4.393408985s) [upload=2718]: Done uploading segments... Aug 8 20:00:09.962348250 (2h34m4.393428381s) [upload=2718]: Upload finished. err: <nil> Duration: 6.151472716s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........XX...........X..X.....X............................] duration: 1.901006911s FAIL (2025-08-08 20:04:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.901030929s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.......................X......X..X........X..X......XX......] duration: 6.822320282s FAIL (2025-08-08 20:04:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 20:00:07.141148811 (2h34m1.572228952s) [upload=2718]: Starting upload Aug 8 20:00:07.141280754 (2h34m1.572360895s) [upload=2718]: Done starting upload Aug 8 20:00:07.141422014 (2h34m1.572502155s) [upload=2718]: Uploading segments... Aug 8 20:00:07.141595335 (2h34m1.572675477s) [upload=2718]: Got next segment. Inline: false Aug 8 20:00:07.141741656 (2h34m1.572821797s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 20:00:07.141749080 (2h34m1.572829221s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 20:00:07.595746990 (2h34m2.026827141s) [seg_pos={0 0}, upload=2718]: Begin upload segment... Aug 8 20:00:07.595861239 (2h34m2.02694137s) [seg_pos={0 0}, upload=2718]: Done begin upload segment. Aug 8 20:00:07.595922787 (2h34m2.027002918s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.595956251 (2h34m2.027036392s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596715754 (2h34m2.027795885s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596805866 (2h34m2.027885997s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597192105 (2h34m2.028272236s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597391477 (2h34m2.028471608s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597651324 (2h34m2.028731465s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597726848 (2h34m2.028806979s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598206957 (2h34m2.029287088s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598522330 (2h34m2.029602471s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598908479 (2h34m2.02998861s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599216689 (2h34m2.03029683s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599392606 (2h34m2.030472747s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599537142 (2h34m2.030617283s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599824923 (2h34m2.030905054s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600136819 (2h34m2.03121695s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600480467 (2h34m2.031560598s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.602971984 (2h34m2.034052125s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:08.728685362 (2h34m3.159765494s) [upload=2718]: Next returned nil segment Aug 8 20:00:08.728709328 (2h34m3.15978947s) [upload=2718]: Waiting for error group managing segments... Aug 8 20:00:09.077117596 (2h34m3.508197727s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.217534363 (2h34m3.648614495s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.450976516 (2h34m3.882056647s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.458071331 (2h34m3.889151462s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549367257 (2h34m3.980447388s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549680576 (2h34m3.980760717s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.585281862 (2h34m4.016361993s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.591562939 (2h34m4.02264307s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629338826 (2h34m4.060418957s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629644681 (2h34m4.060724812s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.642784231 (2h34m4.073864362s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.653643208 (2h34m4.084723339s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662115969 (2h34m4.0931961s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662332091 (2h34m4.093412222s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662358973 (2h34m4.093439104s) [seg_pos={0 0}, upload=2718]: Segment reached optimal threshold of 14 pieces. Aug 8 20:00:09.662507337 (2h34m4.093587468s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBuWLogtN8mv4nwXDpzGdQtbKDz1EfVENSjXC54QdFp2fJg99): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662578122 (2h34m4.093658253s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YU8onCrXzQdzfNwpsiVT6tep4oUrKtazu7Cg9f8atWJoKrXyC): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662633248 (2h34m4.093713379s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662649890 (2h34m4.093730021s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v4QJpSy7hk4pShMu3FswnZAf3rzyCNUx5sUZSPSvxpecY8T9X): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662663306 (2h34m4.093743437s) [seg_pos={0 0}, upload=2718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 20:00:09.662759469 (2h34m4.093839611s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 20:00:09.662765972 (2h34m4.093846133s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 20:00:09.962328854 (2h34m4.393408985s) [upload=2718]: Done uploading segments... Aug 8 20:00:09.962348250 (2h34m4.393428381s) [upload=2718]: Upload finished. err: <nil> Duration: 6.822345421s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..........XX...........X..X.....X...........................] duration: 1.866540046s FAIL (2025-08-08 20:03:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.866562408s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [........................X......X..X........X..X......XX.....] duration: 7.139715894s FAIL (2025-08-08 20:03:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 20:00:07.141148811 (2h34m1.572228952s) [upload=2718]: Starting upload Aug 8 20:00:07.141280754 (2h34m1.572360895s) [upload=2718]: Done starting upload Aug 8 20:00:07.141422014 (2h34m1.572502155s) [upload=2718]: Uploading segments... Aug 8 20:00:07.141595335 (2h34m1.572675477s) [upload=2718]: Got next segment. Inline: false Aug 8 20:00:07.141741656 (2h34m1.572821797s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 20:00:07.141749080 (2h34m1.572829221s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 20:00:07.595746990 (2h34m2.026827141s) [seg_pos={0 0}, upload=2718]: Begin upload segment... Aug 8 20:00:07.595861239 (2h34m2.02694137s) [seg_pos={0 0}, upload=2718]: Done begin upload segment. Aug 8 20:00:07.595922787 (2h34m2.027002918s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.595956251 (2h34m2.027036392s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596715754 (2h34m2.027795885s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596805866 (2h34m2.027885997s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597192105 (2h34m2.028272236s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597391477 (2h34m2.028471608s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597651324 (2h34m2.028731465s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597726848 (2h34m2.028806979s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598206957 (2h34m2.029287088s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598522330 (2h34m2.029602471s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598908479 (2h34m2.02998861s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599216689 (2h34m2.03029683s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599392606 (2h34m2.030472747s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599537142 (2h34m2.030617283s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599824923 (2h34m2.030905054s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600136819 (2h34m2.03121695s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600480467 (2h34m2.031560598s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.602971984 (2h34m2.034052125s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:08.728685362 (2h34m3.159765494s) [upload=2718]: Next returned nil segment Aug 8 20:00:08.728709328 (2h34m3.15978947s) [upload=2718]: Waiting for error group managing segments... Aug 8 20:00:09.077117596 (2h34m3.508197727s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.217534363 (2h34m3.648614495s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.450976516 (2h34m3.882056647s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.458071331 (2h34m3.889151462s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549367257 (2h34m3.980447388s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549680576 (2h34m3.980760717s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.585281862 (2h34m4.016361993s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.591562939 (2h34m4.02264307s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629338826 (2h34m4.060418957s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629644681 (2h34m4.060724812s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.642784231 (2h34m4.073864362s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.653643208 (2h34m4.084723339s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662115969 (2h34m4.0931961s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662332091 (2h34m4.093412222s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662358973 (2h34m4.093439104s) [seg_pos={0 0}, upload=2718]: Segment reached optimal threshold of 14 pieces. Aug 8 20:00:09.662507337 (2h34m4.093587468s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBuWLogtN8mv4nwXDpzGdQtbKDz1EfVENSjXC54QdFp2fJg99): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662578122 (2h34m4.093658253s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YU8onCrXzQdzfNwpsiVT6tep4oUrKtazu7Cg9f8atWJoKrXyC): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662633248 (2h34m4.093713379s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662649890 (2h34m4.093730021s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v4QJpSy7hk4pShMu3FswnZAf3rzyCNUx5sUZSPSvxpecY8T9X): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662663306 (2h34m4.093743437s) [seg_pos={0 0}, upload=2718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 20:00:09.662759469 (2h34m4.093839611s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 20:00:09.662765972 (2h34m4.093846133s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 20:00:09.962328854 (2h34m4.393408985s) [upload=2718]: Done uploading segments... Aug 8 20:00:09.962348250 (2h34m4.393428381s) [upload=2718]: Upload finished. err: <nil> Duration: 7.139739669s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...........XX...........X..X.....X..........................] duration: 1.870693274s FAIL (2025-08-08 20:03:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.870716146s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.........................X......X..X........X..X......XX....] duration: 5.931373462s FAIL (2025-08-08 20:02:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 20:00:07.141148811 (2h34m1.572228952s) [upload=2718]: Starting upload Aug 8 20:00:07.141280754 (2h34m1.572360895s) [upload=2718]: Done starting upload Aug 8 20:00:07.141422014 (2h34m1.572502155s) [upload=2718]: Uploading segments... Aug 8 20:00:07.141595335 (2h34m1.572675477s) [upload=2718]: Got next segment. Inline: false Aug 8 20:00:07.141741656 (2h34m1.572821797s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 20:00:07.141749080 (2h34m1.572829221s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 20:00:07.595746990 (2h34m2.026827141s) [seg_pos={0 0}, upload=2718]: Begin upload segment... Aug 8 20:00:07.595861239 (2h34m2.02694137s) [seg_pos={0 0}, upload=2718]: Done begin upload segment. Aug 8 20:00:07.595922787 (2h34m2.027002918s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.595956251 (2h34m2.027036392s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596715754 (2h34m2.027795885s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596805866 (2h34m2.027885997s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597192105 (2h34m2.028272236s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597391477 (2h34m2.028471608s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597651324 (2h34m2.028731465s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597726848 (2h34m2.028806979s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598206957 (2h34m2.029287088s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598522330 (2h34m2.029602471s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598908479 (2h34m2.02998861s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599216689 (2h34m2.03029683s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599392606 (2h34m2.030472747s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599537142 (2h34m2.030617283s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599824923 (2h34m2.030905054s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600136819 (2h34m2.03121695s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600480467 (2h34m2.031560598s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.602971984 (2h34m2.034052125s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:08.728685362 (2h34m3.159765494s) [upload=2718]: Next returned nil segment Aug 8 20:00:08.728709328 (2h34m3.15978947s) [upload=2718]: Waiting for error group managing segments... Aug 8 20:00:09.077117596 (2h34m3.508197727s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.217534363 (2h34m3.648614495s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.450976516 (2h34m3.882056647s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.458071331 (2h34m3.889151462s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549367257 (2h34m3.980447388s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549680576 (2h34m3.980760717s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.585281862 (2h34m4.016361993s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.591562939 (2h34m4.02264307s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629338826 (2h34m4.060418957s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629644681 (2h34m4.060724812s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.642784231 (2h34m4.073864362s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.653643208 (2h34m4.084723339s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662115969 (2h34m4.0931961s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662332091 (2h34m4.093412222s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662358973 (2h34m4.093439104s) [seg_pos={0 0}, upload=2718]: Segment reached optimal threshold of 14 pieces. Aug 8 20:00:09.662507337 (2h34m4.093587468s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBuWLogtN8mv4nwXDpzGdQtbKDz1EfVENSjXC54QdFp2fJg99): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662578122 (2h34m4.093658253s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YU8onCrXzQdzfNwpsiVT6tep4oUrKtazu7Cg9f8atWJoKrXyC): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662633248 (2h34m4.093713379s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662649890 (2h34m4.093730021s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v4QJpSy7hk4pShMu3FswnZAf3rzyCNUx5sUZSPSvxpecY8T9X): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662663306 (2h34m4.093743437s) [seg_pos={0 0}, upload=2718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 20:00:09.662759469 (2h34m4.093839611s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 20:00:09.662765972 (2h34m4.093846133s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 20:00:09.962328854 (2h34m4.393408985s) [upload=2718]: Done uploading segments... Aug 8 20:00:09.962348250 (2h34m4.393428381s) [upload=2718]: Upload finished. err: <nil> Duration: 5.931397456s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 8 out of 60 is failed (threshold=3) [X.........................X......X..X........X..X......XX...] duration: 6.360974446s FAIL (2025-08-08 20:02:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 20:00:07.141148811 (2h34m1.572228952s) [upload=2718]: Starting upload Aug 8 20:00:07.141280754 (2h34m1.572360895s) [upload=2718]: Done starting upload Aug 8 20:00:07.141422014 (2h34m1.572502155s) [upload=2718]: Uploading segments... Aug 8 20:00:07.141595335 (2h34m1.572675477s) [upload=2718]: Got next segment. Inline: false Aug 8 20:00:07.141741656 (2h34m1.572821797s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 20:00:07.141749080 (2h34m1.572829221s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 20:00:07.595746990 (2h34m2.026827141s) [seg_pos={0 0}, upload=2718]: Begin upload segment... Aug 8 20:00:07.595861239 (2h34m2.02694137s) [seg_pos={0 0}, upload=2718]: Done begin upload segment. Aug 8 20:00:07.595922787 (2h34m2.027002918s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.595956251 (2h34m2.027036392s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596715754 (2h34m2.027795885s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596805866 (2h34m2.027885997s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597192105 (2h34m2.028272236s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597391477 (2h34m2.028471608s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597651324 (2h34m2.028731465s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597726848 (2h34m2.028806979s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598206957 (2h34m2.029287088s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598522330 (2h34m2.029602471s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598908479 (2h34m2.02998861s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599216689 (2h34m2.03029683s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599392606 (2h34m2.030472747s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599537142 (2h34m2.030617283s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599824923 (2h34m2.030905054s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600136819 (2h34m2.03121695s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600480467 (2h34m2.031560598s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.602971984 (2h34m2.034052125s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:08.728685362 (2h34m3.159765494s) [upload=2718]: Next returned nil segment Aug 8 20:00:08.728709328 (2h34m3.15978947s) [upload=2718]: Waiting for error group managing segments... Aug 8 20:00:09.077117596 (2h34m3.508197727s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.217534363 (2h34m3.648614495s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.450976516 (2h34m3.882056647s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.458071331 (2h34m3.889151462s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549367257 (2h34m3.980447388s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549680576 (2h34m3.980760717s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.585281862 (2h34m4.016361993s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.591562939 (2h34m4.02264307s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629338826 (2h34m4.060418957s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629644681 (2h34m4.060724812s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.642784231 (2h34m4.073864362s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.653643208 (2h34m4.084723339s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662115969 (2h34m4.0931961s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662332091 (2h34m4.093412222s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662358973 (2h34m4.093439104s) [seg_pos={0 0}, upload=2718]: Segment reached optimal threshold of 14 pieces. Aug 8 20:00:09.662507337 (2h34m4.093587468s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBuWLogtN8mv4nwXDpzGdQtbKDz1EfVENSjXC54QdFp2fJg99): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662578122 (2h34m4.093658253s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YU8onCrXzQdzfNwpsiVT6tep4oUrKtazu7Cg9f8atWJoKrXyC): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662633248 (2h34m4.093713379s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662649890 (2h34m4.093730021s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v4QJpSy7hk4pShMu3FswnZAf3rzyCNUx5sUZSPSvxpecY8T9X): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662663306 (2h34m4.093743437s) [seg_pos={0 0}, upload=2718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 20:00:09.662759469 (2h34m4.093839611s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 20:00:09.662765972 (2h34m4.093846133s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 20:00:09.962328854 (2h34m4.393408985s) [upload=2718]: Done uploading segments... Aug 8 20:00:09.962348250 (2h34m4.393428381s) [upload=2718]: Upload finished. err: <nil> Duration: 6.360999543s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [............XX...........X..X.....X.........................] duration: 2.220594586s FAIL (2025-08-08 20:02:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.220619434s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 8 out of 60 is failed (threshold=3) [.X.........................X......X..X........X..X......XX..] duration: 5.871981274s FAIL (2025-08-08 20:01:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 20:00:07.141148811 (2h34m1.572228952s) [upload=2718]: Starting upload Aug 8 20:00:07.141280754 (2h34m1.572360895s) [upload=2718]: Done starting upload Aug 8 20:00:07.141422014 (2h34m1.572502155s) [upload=2718]: Uploading segments... Aug 8 20:00:07.141595335 (2h34m1.572675477s) [upload=2718]: Got next segment. Inline: false Aug 8 20:00:07.141741656 (2h34m1.572821797s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 20:00:07.141749080 (2h34m1.572829221s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 20:00:07.595746990 (2h34m2.026827141s) [seg_pos={0 0}, upload=2718]: Begin upload segment... Aug 8 20:00:07.595861239 (2h34m2.02694137s) [seg_pos={0 0}, upload=2718]: Done begin upload segment. Aug 8 20:00:07.595922787 (2h34m2.027002918s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.595956251 (2h34m2.027036392s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596715754 (2h34m2.027795885s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596805866 (2h34m2.027885997s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597192105 (2h34m2.028272236s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597391477 (2h34m2.028471608s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597651324 (2h34m2.028731465s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597726848 (2h34m2.028806979s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598206957 (2h34m2.029287088s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598522330 (2h34m2.029602471s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598908479 (2h34m2.02998861s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599216689 (2h34m2.03029683s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599392606 (2h34m2.030472747s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599537142 (2h34m2.030617283s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599824923 (2h34m2.030905054s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600136819 (2h34m2.03121695s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600480467 (2h34m2.031560598s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.602971984 (2h34m2.034052125s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:08.728685362 (2h34m3.159765494s) [upload=2718]: Next returned nil segment Aug 8 20:00:08.728709328 (2h34m3.15978947s) [upload=2718]: Waiting for error group managing segments... Aug 8 20:00:09.077117596 (2h34m3.508197727s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.217534363 (2h34m3.648614495s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.450976516 (2h34m3.882056647s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.458071331 (2h34m3.889151462s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549367257 (2h34m3.980447388s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549680576 (2h34m3.980760717s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.585281862 (2h34m4.016361993s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.591562939 (2h34m4.02264307s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629338826 (2h34m4.060418957s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629644681 (2h34m4.060724812s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.642784231 (2h34m4.073864362s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.653643208 (2h34m4.084723339s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662115969 (2h34m4.0931961s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662332091 (2h34m4.093412222s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662358973 (2h34m4.093439104s) [seg_pos={0 0}, upload=2718]: Segment reached optimal threshold of 14 pieces. Aug 8 20:00:09.662507337 (2h34m4.093587468s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBuWLogtN8mv4nwXDpzGdQtbKDz1EfVENSjXC54QdFp2fJg99): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662578122 (2h34m4.093658253s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YU8onCrXzQdzfNwpsiVT6tep4oUrKtazu7Cg9f8atWJoKrXyC): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662633248 (2h34m4.093713379s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662649890 (2h34m4.093730021s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v4QJpSy7hk4pShMu3FswnZAf3rzyCNUx5sUZSPSvxpecY8T9X): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662663306 (2h34m4.093743437s) [seg_pos={0 0}, upload=2718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 20:00:09.662759469 (2h34m4.093839611s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 20:00:09.662765972 (2h34m4.093846133s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 20:00:09.962328854 (2h34m4.393408985s) [upload=2718]: Done uploading segments... Aug 8 20:00:09.962348250 (2h34m4.393428381s) [upload=2718]: Upload finished. err: <nil> Duration: 5.872005441s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.............XX...........X..X.....X........................] duration: 1.873380043s FAIL (2025-08-08 20:01:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.873415009s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..............XX...........X..X.....X.......................] duration: 1.867987807s FAIL (2025-08-08 20:00:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.868013506s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 8 out of 60 is failed (threshold=3) [..X.........................X......X..X........X..X......XX.] duration: 5.809381112s FAIL (2025-08-08 20:00:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 20:00:07.141148811 (2h34m1.572228952s) [upload=2718]: Starting upload Aug 8 20:00:07.141280754 (2h34m1.572360895s) [upload=2718]: Done starting upload Aug 8 20:00:07.141422014 (2h34m1.572502155s) [upload=2718]: Uploading segments... Aug 8 20:00:07.141595335 (2h34m1.572675477s) [upload=2718]: Got next segment. Inline: false Aug 8 20:00:07.141741656 (2h34m1.572821797s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 20:00:07.141749080 (2h34m1.572829221s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 20:00:07.595746990 (2h34m2.026827141s) [seg_pos={0 0}, upload=2718]: Begin upload segment... Aug 8 20:00:07.595861239 (2h34m2.02694137s) [seg_pos={0 0}, upload=2718]: Done begin upload segment. Aug 8 20:00:07.595922787 (2h34m2.027002918s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.595956251 (2h34m2.027036392s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596715754 (2h34m2.027795885s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596805866 (2h34m2.027885997s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597192105 (2h34m2.028272236s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597391477 (2h34m2.028471608s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597651324 (2h34m2.028731465s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597726848 (2h34m2.028806979s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598206957 (2h34m2.029287088s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598522330 (2h34m2.029602471s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598908479 (2h34m2.02998861s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599216689 (2h34m2.03029683s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599392606 (2h34m2.030472747s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599537142 (2h34m2.030617283s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599824923 (2h34m2.030905054s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600136819 (2h34m2.03121695s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600480467 (2h34m2.031560598s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.602971984 (2h34m2.034052125s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:08.728685362 (2h34m3.159765494s) [upload=2718]: Next returned nil segment Aug 8 20:00:08.728709328 (2h34m3.15978947s) [upload=2718]: Waiting for error group managing segments... Aug 8 20:00:09.077117596 (2h34m3.508197727s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.217534363 (2h34m3.648614495s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.450976516 (2h34m3.882056647s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.458071331 (2h34m3.889151462s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549367257 (2h34m3.980447388s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549680576 (2h34m3.980760717s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.585281862 (2h34m4.016361993s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.591562939 (2h34m4.02264307s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629338826 (2h34m4.060418957s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629644681 (2h34m4.060724812s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.642784231 (2h34m4.073864362s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.653643208 (2h34m4.084723339s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662115969 (2h34m4.0931961s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662332091 (2h34m4.093412222s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662358973 (2h34m4.093439104s) [seg_pos={0 0}, upload=2718]: Segment reached optimal threshold of 14 pieces. Aug 8 20:00:09.662507337 (2h34m4.093587468s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBuWLogtN8mv4nwXDpzGdQtbKDz1EfVENSjXC54QdFp2fJg99): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662578122 (2h34m4.093658253s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YU8onCrXzQdzfNwpsiVT6tep4oUrKtazu7Cg9f8atWJoKrXyC): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662633248 (2h34m4.093713379s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662649890 (2h34m4.093730021s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v4QJpSy7hk4pShMu3FswnZAf3rzyCNUx5sUZSPSvxpecY8T9X): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662663306 (2h34m4.093743437s) [seg_pos={0 0}, upload=2718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 20:00:09.662759469 (2h34m4.093839611s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 20:00:09.662765972 (2h34m4.093846133s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 20:00:09.962328854 (2h34m4.393408985s) [upload=2718]: Done uploading segments... Aug 8 20:00:09.962348250 (2h34m4.393428381s) [upload=2718]: Upload finished. err: <nil> Duration: 5.809398215s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 8 out of 60 is failed (threshold=3) [...X.........................X......X..X........X..X......XX] duration: 3.951021178s FAIL (2025-08-08 20:00:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 8 20:00:07.141148811 (2h34m1.572228952s) [upload=2718]: Starting upload Aug 8 20:00:07.141280754 (2h34m1.572360895s) [upload=2718]: Done starting upload Aug 8 20:00:07.141422014 (2h34m1.572502155s) [upload=2718]: Uploading segments... Aug 8 20:00:07.141595335 (2h34m1.572675477s) [upload=2718]: Got next segment. Inline: false Aug 8 20:00:07.141741656 (2h34m1.572821797s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 20:00:07.141749080 (2h34m1.572829221s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 20:00:07.595746990 (2h34m2.026827141s) [seg_pos={0 0}, upload=2718]: Begin upload segment... Aug 8 20:00:07.595861239 (2h34m2.02694137s) [seg_pos={0 0}, upload=2718]: Done begin upload segment. Aug 8 20:00:07.595922787 (2h34m2.027002918s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.595956251 (2h34m2.027036392s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596715754 (2h34m2.027795885s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.596805866 (2h34m2.027885997s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597192105 (2h34m2.028272236s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597391477 (2h34m2.028471608s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597651324 (2h34m2.028731465s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.597726848 (2h34m2.028806979s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598206957 (2h34m2.029287088s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598522330 (2h34m2.029602471s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.598908479 (2h34m2.02998861s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599216689 (2h34m2.03029683s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599392606 (2h34m2.030472747s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599537142 (2h34m2.030617283s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.599824923 (2h34m2.030905054s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600136819 (2h34m2.03121695s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.600480467 (2h34m2.031560598s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:07.602971984 (2h34m2.034052125s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Uploading piece... Aug 8 20:00:08.728685362 (2h34m3.159765494s) [upload=2718]: Next returned nil segment Aug 8 20:00:08.728709328 (2h34m3.15978947s) [upload=2718]: Waiting for error group managing segments... Aug 8 20:00:09.077117596 (2h34m3.508197727s) [noise=true , address=64.49.13.27:4964 , piece_id=WCKAK3Y63IE7LABMG63K4HJ34JETQR7HWMZXY4L62MXMDV52GYOQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.217534363 (2h34m3.648614495s) [noise=true , address=64.49.13.138:4481 , piece_id=YD23QMXTIABNM3RYYGA4FPTKXR5SB65EDI6VRW3TDSSZRIIWL4TA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.450976516 (2h34m3.882056647s) [noise=true , address=79.127.201.215:4344 , piece_id=Z2F33PV5GISYQY7OKQCRJBMIOCYOXUWA2AIOSEGQRREN73DRKTFQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.458071331 (2h34m3.889151462s) [noise=true , address=79.127.219.51:4192 , piece_id=IAXL6ZGTWAPHQFQ2ZC3KWYBJNHX6GGZFRJ7W4Z2PXE2TTZ22UD6A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549367257 (2h34m3.980447388s) [noise=true , address=79.127.201.215:4346 , piece_id=VMMFSEN2FVWDOJDEKBWD7SBNTI6XAS62MAQFS2CURBFLCLHETO3A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.549680576 (2h34m3.980760717s) [noise=true , address=104.36.82.60:4364 , piece_id=2HXBUCIACPYUQISWQP7PVN3XDOXNH34RYV4XPXTVOE33OQDT7QKQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.585281862 (2h34m4.016361993s) [noise=true , address=104.36.82.44:4889 , piece_id=D72X62L3S2W22XLX2K2WOYRLEH6D36YK3FJFZG274DSQPKGCIVFA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.591562939 (2h34m4.02264307s) [noise=true , address=104.36.82.53:4152 , piece_id=L32KHQ4CRHP35TFAVRFIXWOYW5NVJEUEG76LPGQPRS6XK5MW5G4A, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629338826 (2h34m4.060418957s) [noise=true , address=104.36.82.14:4234 , piece_id=U7UXXEXE6IXFJMK3GPSZVY4FTDZ6HPLXF3JMQQMTHVUJBBT5QQTQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.629644681 (2h34m4.060724812s) [noise=true , address=104.36.82.61:4388 , piece_id=UU6G4UBAKM57ITXOI4KSCUD6TA66QQ2W5FBUDBW66UDNWBSS4GUQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.642784231 (2h34m4.073864362s) [noise=true , address=104.36.82.35:4594 , piece_id=YOLY5YH3P5TW4JK5K6VFESJUG6W5ZNWOYGXYWVURGB5UVZJ6CUUA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.653643208 (2h34m4.084723339s) [noise=true , address=104.36.82.19:4402 , piece_id=IHCIHDVFKWO54RYE2HFGWL64HO5GFDUGGQMXS64OAFCABA5U2IRQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662115969 (2h34m4.0931961s) [noise=true , address=104.36.82.46:4515 , piece_id=2WHVNVNH6RF37AUWLXHVMFV6KGRBLFBU4PL6ZMTNPMXY5CNXNVPQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662332091 (2h34m4.093412222s) [noise=true , address=104.36.82.54:4187 , piece_id=FS3C6DP5JE6KTQN5322NKCMY3XHDCWSB4Q476LWGJBRDAWRUMPQA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: <nil> Aug 8 20:00:09.662358973 (2h34m4.093439104s) [seg_pos={0 0}, upload=2718]: Segment reached optimal threshold of 14 pieces. Aug 8 20:00:09.662507337 (2h34m4.093587468s) [noise=true , address=104.36.82.37:4659 , piece_id=VDUW75PMZZTXW6AJT73NAJMZJB6SOBLTICCR2PV2OAM6YL2OXQJQ, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBuWLogtN8mv4nwXDpzGdQtbKDz1EfVENSjXC54QdFp2fJg99): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662578122 (2h34m4.093658253s) [noise=true , address=104.36.82.17:4340 , piece_id=UY6PYK4IYUJMQLYKVYQCFL772FT7CKSWDL6S2D7C3DCZJHHDFAYA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YU8onCrXzQdzfNwpsiVT6tep4oUrKtazu7Cg9f8atWJoKrXyC): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662633248 (2h34m4.093713379s) [noise=true , address=104.36.82.16:4300 , piece_id=YK5KDUWD47FGSG7FNWOSRHBNIWASVLWFQWO63YHAR6LHKMZFJBLA, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662649890 (2h34m4.093730021s) [noise=true , address=104.36.82.58:4289 , piece_id=WZUY6U25KY3MNFB5FCITR4A4WBRS7ADO7CQ4HBELEIPOFN4WHC3Q, seg_pos={0 0}, upload=2718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v4QJpSy7hk4pShMu3FswnZAf3rzyCNUx5sUZSPSvxpecY8T9X): protocol: expected piece hash; context canceled; EOF Aug 8 20:00:09.662663306 (2h34m4.093743437s) [seg_pos={0 0}, upload=2718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 20:00:09.662759469 (2h34m4.093839611s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 20:00:09.662765972 (2h34m4.093846133s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 20:00:09.962328854 (2h34m4.393408985s) [upload=2718]: Done uploading segments... Aug 8 20:00:09.962348250 (2h34m4.393428381s) [upload=2718]: Upload finished. err: <nil> Duration: 3.951055675s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [....X.........................X......X..X........X..X......X] duration: 6.330254088s FAIL (2025-08-08 19:59:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1976d8ed593e5035e5d2d5e06daeb1188a0cc106ab8df915aeacf9fc97cfdd05 != before f51a2e9743c68bd940f1aec0b7375483d2bdb446d177cbf103702860acdd9a85 ======LOGS====== Aug 8 19:59:47.266433492 (2h33m41.697513623s) [upload=2712]: Starting upload Aug 8 19:59:47.266485372 (2h33m41.697565503s) [upload=2712]: Done starting upload Aug 8 19:59:47.266608067 (2h33m41.697688188s) [upload=2712]: Uploading segments... Aug 8 19:59:47.266698149 (2h33m41.69777828s) [upload=2712]: Got next segment. Inline: false Aug 8 19:59:47.266741311 (2h33m41.697821442s) [upload=2712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:59:47.266746352 (2h33m41.697826483s) [upload=2712]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:59:47.718811173 (2h33m42.149891314s) [seg_pos={0 0}, upload=2712]: Begin upload segment... Aug 8 19:59:47.718861640 (2h33m42.149941801s) [seg_pos={0 0}, upload=2712]: Done begin upload segment. Aug 8 19:59:47.718891627 (2h33m42.149971758s) [noise=true , address=79.127.201.215:4360 , piece_id=LBZLZA7KLEKI2TODKLFR7KCB3LHO7E7M4JEIXTZEFU2ZHT4AP4SQ, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.718897218 (2h33m42.149977349s) [noise=true , address=104.36.82.17:4350 , piece_id=7JXD7AUZU3V65NRWFLLY7TLGIQGSXAR77LIBLV5VMPRHHSXYODRA, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.718937505 (2h33m42.150017636s) [noise=true , address=79.127.205.233:4633 , piece_id=ADGQFZJRT747WGPDTTKBOAFTT3L5SQVKPTJMYESGJNNRRISGRY5Q, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.719256435 (2h33m42.150336566s) [noise=true , address=104.36.82.58:4289 , piece_id=ZPDFCRY5QQOD5UZJSSRQFN4VU7ICJWRWL2A5ZS7GTRFP32B7PUPA, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.719273217 (2h33m42.150353349s) [noise=true , address=104.36.82.53:4151 , piece_id=QJS43SN6RUFG73QO4JHEVG7G3BG3XGOVKXDIXJBRU5ZPWKZSISRQ, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.719532493 (2h33m42.150612624s) [noise=true , address=104.36.82.22:4530 , piece_id=V65O6W6YXR2RZ5AAA6MXUE4JVZO7F6BOKQNQC64S6OZ635B65IVQ, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.719620211 (2h33m42.150700342s) [noise=true , address=104.36.82.59:4324 , piece_id=LTTTIT5N75J34X5CD7K2BNLGLPX6MR6NP2G6OKSZLW2HFZVSX34A, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.719790558 (2h33m42.150870689s) [noise=true , address=45.91.116.8:4076 , piece_id=2WXYWNL3T4F7EOPJCSP3JTY2LPZWIH3RVPTIMYKIFETCZV6KYOIQ, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.719937418 (2h33m42.151017549s) [noise=true , address=104.36.82.46:4503 , piece_id=2P2NNH4FO6HSXV5J6YB6RCNERVAYVFSWSCQREULO2DRN523XXFFQ, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.720026999 (2h33m42.15110713s) [noise=true , address=104.36.82.62:4414 , piece_id=SIA56IJO7ZZKEWTDRXVPVDUDDJ23ZCUNEY77KEVGKBN6HFAEH5GQ, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.720174823 (2h33m42.151254954s) [noise=true , address=64.49.13.27:4968 , piece_id=YD66KQNAA25TM3KQQHRWEX3NCSBIE5P65JSVPXV2NUBDUC7T2PQA, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.720313388 (2h33m42.151393519s) [noise=true , address=64.49.13.26:4949 , piece_id=QOOXTHCMZLDIGFXR4NHKF7WM3CINRF2ID7SDZZ574WYBGHXUMMVQ, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.720442815 (2h33m42.151522946s) [noise=true , address=45.91.116.14:4214 , piece_id=FUTH2LJNHPCZJ34FFY3ULKKRIEKUPDZNBOO54E3JG3G3MBQ4KKSA, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.720644972 (2h33m42.151725103s) [noise=true , address=104.36.82.23:4445 , piece_id=IIJYA5UBEEGLNWGEC4NRPIEDERLNHN4LNP37MSRVDBX3DU2HQAJA, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.720684367 (2h33m42.151764498s) [noise=true , address=104.36.82.4:4819 , piece_id=ZUB5GPQJD3IHBAVQTKPLHFLZYAROQFMFS3DJDOACBYCVBEIIJ6DA, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.720860415 (2h33m42.151940546s) [noise=true , address=104.36.82.36:4636 , piece_id=OROKKRGXV7OMTVBRHTSRINGL74PBBFOEDJOH5M4MVMPZPIPI3XEA, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.721054696 (2h33m42.152134817s) [noise=true , address=104.36.82.3:4793 , piece_id=NXUXDQKHVGC6KNTUCUNMVWZIJ6ZRSROJZDGLRW6D3T5W6OOWNREA, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:47.721242395 (2h33m42.152322526s) [noise=true , address=64.49.13.170:4728 , piece_id=ZZGQYKMCFG7VX34FWB6I3ZNMLPUHLXL7BW3SYWDE55GCL6SJHQKQ, seg_pos={0 0}, upload=2712]: Uploading piece... Aug 8 19:59:48.824844668 (2h33m43.255924799s) [upload=2712]: Next returned nil segment Aug 8 19:59:48.824860188 (2h33m43.255940319s) [upload=2712]: Waiting for error group managing segments... Aug 8 19:59:49.105634692 (2h33m43.536714823s) [noise=true , address=79.127.205.233:4633 , piece_id=ADGQFZJRT747WGPDTTKBOAFTT3L5SQVKPTJMYESGJNNRRISGRY5Q, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.169044724 (2h33m43.600124855s) [noise=true , address=64.49.13.27:4968 , piece_id=YD66KQNAA25TM3KQQHRWEX3NCSBIE5P65JSVPXV2NUBDUC7T2PQA, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.170077009 (2h33m43.60115714s) [noise=true , address=64.49.13.170:4728 , piece_id=ZZGQYKMCFG7VX34FWB6I3ZNMLPUHLXL7BW3SYWDE55GCL6SJHQKQ, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.243185728 (2h33m43.674265859s) [noise=true , address=64.49.13.26:4949 , piece_id=QOOXTHCMZLDIGFXR4NHKF7WM3CINRF2ID7SDZZ574WYBGHXUMMVQ, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.645443374 (2h33m44.076523505s) [noise=true , address=79.127.201.215:4360 , piece_id=LBZLZA7KLEKI2TODKLFR7KCB3LHO7E7M4JEIXTZEFU2ZHT4AP4SQ, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.662803368 (2h33m44.093883499s) [noise=true , address=104.36.82.46:4503 , piece_id=2P2NNH4FO6HSXV5J6YB6RCNERVAYVFSWSCQREULO2DRN523XXFFQ, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.698070635 (2h33m44.129150766s) [noise=true , address=104.36.82.4:4819 , piece_id=ZUB5GPQJD3IHBAVQTKPLHFLZYAROQFMFS3DJDOACBYCVBEIIJ6DA, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.705411300 (2h33m44.136491431s) [noise=true , address=104.36.82.3:4793 , piece_id=NXUXDQKHVGC6KNTUCUNMVWZIJ6ZRSROJZDGLRW6D3T5W6OOWNREA, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.733399018 (2h33m44.164479139s) [noise=true , address=45.91.116.14:4214 , piece_id=FUTH2LJNHPCZJ34FFY3ULKKRIEKUPDZNBOO54E3JG3G3MBQ4KKSA, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.743517007 (2h33m44.174597128s) [noise=true , address=45.91.116.8:4076 , piece_id=2WXYWNL3T4F7EOPJCSP3JTY2LPZWIH3RVPTIMYKIFETCZV6KYOIQ, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.771495419 (2h33m44.20257554s) [noise=true , address=104.36.82.58:4289 , piece_id=ZPDFCRY5QQOD5UZJSSRQFN4VU7ICJWRWL2A5ZS7GTRFP32B7PUPA, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.800309347 (2h33m44.231389478s) [noise=true , address=104.36.82.36:4636 , piece_id=OROKKRGXV7OMTVBRHTSRINGL74PBBFOEDJOH5M4MVMPZPIPI3XEA, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.944134547 (2h33m44.375214678s) [noise=true , address=104.36.82.62:4414 , piece_id=SIA56IJO7ZZKEWTDRXVPVDUDDJ23ZCUNEY77KEVGKBN6HFAEH5GQ, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.992522307 (2h33m44.423602438s) [noise=true , address=104.36.82.53:4151 , piece_id=QJS43SN6RUFG73QO4JHEVG7G3BG3XGOVKXDIXJBRU5ZPWKZSISRQ, seg_pos={0 0}, upload=2712]: Done uploading piece. err: <nil> Aug 8 19:59:49.992550711 (2h33m44.423630842s) [seg_pos={0 0}, upload=2712]: Segment reached optimal threshold of 14 pieces. Aug 8 19:59:49.992681281 (2h33m44.423761412s) [noise=true , address=104.36.82.23:4445 , piece_id=IIJYA5UBEEGLNWGEC4NRPIEDERLNHN4LNP37MSRVDBX3DU2HQAJA, seg_pos={0 0}, upload=2712]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: expected piece hash; context canceled; EOF Aug 8 19:59:49.992784138 (2h33m44.423864269s) [noise=true , address=104.36.82.17:4350 , piece_id=7JXD7AUZU3V65NRWFLLY7TLGIQGSXAR77LIBLV5VMPRHHSXYODRA, seg_pos={0 0}, upload=2712]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cgYc8zVZh7w7iTTDC5zq1xK12wa5357zdAH3F3bZ21n1Y8uLg): protocol: expected piece hash; context canceled; EOF Aug 8 19:59:49.992813464 (2h33m44.423893595s) [noise=true , address=104.36.82.22:4530 , piece_id=V65O6W6YXR2RZ5AAA6MXUE4JVZO7F6BOKQNQC64S6OZ635B65IVQ, seg_pos={0 0}, upload=2712]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1akHUSoQFafzkGTJ385iYaowc87pJBDNfU5hodSCUDFa5ojN3v): protocol: expected piece hash; context canceled; EOF Aug 8 19:59:49.992904889 (2h33m44.42398502s) [noise=true , address=104.36.82.59:4324 , piece_id=LTTTIT5N75J34X5CD7K2BNLGLPX6MR6NP2G6OKSZLW2HFZVSX34A, seg_pos={0 0}, upload=2712]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: write tcp 188.166.225.170:56726->104.36.82.59:4324: use of closed network connection; write tcp 188.166.225.170:56726->104.36.82.59:4324: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56726->104.36.82.59:4324: use of closed network connection Aug 8 19:59:49.992927773 (2h33m44.424007904s) [seg_pos={0 0}, upload=2712]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 19:59:49.993017003 (2h33m44.424097135s) [upload=2712]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 19:59:49.993021863 (2h33m44.424101984s) [upload=2712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:59:50.460746457 (2h33m44.891826588s) [upload=2712]: Done uploading segments... Aug 8 19:59:50.460763900 (2h33m44.891844031s) [upload=2712]: Upload finished. err: <nil> Duration: 6.330284345s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...............XX...........X..X.....X......................] duration: 2.00503586s FAIL (2025-08-08 19:59:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.005068543s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.....X.........................X......X..X........X..X......] duration: 6.34289651s FAIL (2025-08-08 19:58:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 8 19:55:00.833666684 (2h28m55.264746815s) [upload=2633]: Starting upload Aug 8 19:55:00.833712762 (2h28m55.264792893s) [upload=2633]: Done starting upload Aug 8 19:55:00.833850435 (2h28m55.264930567s) [upload=2633]: Uploading segments... Aug 8 19:55:00.833941379 (2h28m55.26502151s) [upload=2633]: Got next segment. Inline: false Aug 8 19:55:00.833971026 (2h28m55.265051157s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:55:00.833975494 (2h28m55.265055625s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:55:01.291048271 (2h28m55.722128422s) [seg_pos={0 0}, upload=2633]: Begin upload segment... Aug 8 19:55:01.291099119 (2h28m55.72217926s) [seg_pos={0 0}, upload=2633]: Done begin upload segment. Aug 8 19:55:01.291114558 (2h28m55.722194699s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291122303 (2h28m55.722202444s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291167038 (2h28m55.722247179s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291221713 (2h28m55.722301864s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291629884 (2h28m55.722710025s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291893599 (2h28m55.72297373s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292115904 (2h28m55.723196035s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292343419 (2h28m55.72342355s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292698308 (2h28m55.723778439s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292952555 (2h28m55.724032686s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293153248 (2h28m55.724233379s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293351769 (2h28m55.7244319s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293558013 (2h28m55.724638144s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293872395 (2h28m55.724952526s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294152331 (2h28m55.725232462s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294364987 (2h28m55.725445118s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294571552 (2h28m55.725651683s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294770914 (2h28m55.725851045s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:02.390230402 (2h28m56.821310533s) [upload=2633]: Next returned nil segment Aug 8 19:55:02.390254929 (2h28m56.82133506s) [upload=2633]: Waiting for error group managing segments... Aug 8 19:55:02.704831411 (2h28m57.135911542s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.725613002 (2h28m57.156693143s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.732816184 (2h28m57.163896315s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.765105813 (2h28m57.196185944s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.791704804 (2h28m57.222784935s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.249195771 (2h28m57.680275902s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.259212215 (2h28m57.690292346s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.276265503 (2h28m57.707345644s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.320733273 (2h28m57.751813404s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.325235506 (2h28m57.756315637s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.344273601 (2h28m57.775353732s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.345197439 (2h28m57.77627757s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.346818691 (2h28m57.777898822s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348769443 (2h28m57.779849584s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348782919 (2h28m57.77986305s) [seg_pos={0 0}, upload=2633]: Segment reached optimal threshold of 14 pieces. Aug 8 19:55:03.348897478 (2h28m57.779977599s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pz6ZrFzAdLySCxtFhbotfPLiA4nSmvhp5uaRAJQgSc7DUgmap): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.348957924 (2h28m57.780038055s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349014682 (2h28m57.780094813s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349105597 (2h28m57.780185728s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126g75XgAyFYcgnaibseqoGiz7cK6z3n6gPMcu9TrdjuZUYEHnZ): protocol: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection Aug 8 19:55:03.349162045 (2h28m57.780242176s) [seg_pos={0 0}, upload=2633]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 19:55:03.349262817 (2h28m57.780342948s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 19:55:03.349267607 (2h28m57.780347738s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:55:03.706628016 (2h28m58.137708157s) [upload=2633]: Done uploading segments... Aug 8 19:55:03.706648335 (2h28m58.137728466s) [upload=2633]: Upload finished. err: <nil> Duration: 6.34291752s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [................XX...........X..X.....X.....................] duration: 1.875888755s FAIL (2025-08-08 19:58:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.875922098s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.................XX...........X..X.....X....................] duration: 1.954386612s FAIL (2025-08-08 19:58:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.954412733s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [......X.........................X......X..X........X..X.....] duration: 6.948852267s FAIL (2025-08-08 19:57:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 8 19:55:00.833666684 (2h28m55.264746815s) [upload=2633]: Starting upload Aug 8 19:55:00.833712762 (2h28m55.264792893s) [upload=2633]: Done starting upload Aug 8 19:55:00.833850435 (2h28m55.264930567s) [upload=2633]: Uploading segments... Aug 8 19:55:00.833941379 (2h28m55.26502151s) [upload=2633]: Got next segment. Inline: false Aug 8 19:55:00.833971026 (2h28m55.265051157s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:55:00.833975494 (2h28m55.265055625s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:55:01.291048271 (2h28m55.722128422s) [seg_pos={0 0}, upload=2633]: Begin upload segment... Aug 8 19:55:01.291099119 (2h28m55.72217926s) [seg_pos={0 0}, upload=2633]: Done begin upload segment. Aug 8 19:55:01.291114558 (2h28m55.722194699s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291122303 (2h28m55.722202444s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291167038 (2h28m55.722247179s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291221713 (2h28m55.722301864s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291629884 (2h28m55.722710025s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291893599 (2h28m55.72297373s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292115904 (2h28m55.723196035s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292343419 (2h28m55.72342355s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292698308 (2h28m55.723778439s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292952555 (2h28m55.724032686s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293153248 (2h28m55.724233379s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293351769 (2h28m55.7244319s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293558013 (2h28m55.724638144s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293872395 (2h28m55.724952526s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294152331 (2h28m55.725232462s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294364987 (2h28m55.725445118s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294571552 (2h28m55.725651683s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294770914 (2h28m55.725851045s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:02.390230402 (2h28m56.821310533s) [upload=2633]: Next returned nil segment Aug 8 19:55:02.390254929 (2h28m56.82133506s) [upload=2633]: Waiting for error group managing segments... Aug 8 19:55:02.704831411 (2h28m57.135911542s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.725613002 (2h28m57.156693143s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.732816184 (2h28m57.163896315s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.765105813 (2h28m57.196185944s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.791704804 (2h28m57.222784935s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.249195771 (2h28m57.680275902s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.259212215 (2h28m57.690292346s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.276265503 (2h28m57.707345644s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.320733273 (2h28m57.751813404s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.325235506 (2h28m57.756315637s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.344273601 (2h28m57.775353732s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.345197439 (2h28m57.77627757s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.346818691 (2h28m57.777898822s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348769443 (2h28m57.779849584s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348782919 (2h28m57.77986305s) [seg_pos={0 0}, upload=2633]: Segment reached optimal threshold of 14 pieces. Aug 8 19:55:03.348897478 (2h28m57.779977599s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pz6ZrFzAdLySCxtFhbotfPLiA4nSmvhp5uaRAJQgSc7DUgmap): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.348957924 (2h28m57.780038055s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349014682 (2h28m57.780094813s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349105597 (2h28m57.780185728s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126g75XgAyFYcgnaibseqoGiz7cK6z3n6gPMcu9TrdjuZUYEHnZ): protocol: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection Aug 8 19:55:03.349162045 (2h28m57.780242176s) [seg_pos={0 0}, upload=2633]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 19:55:03.349262817 (2h28m57.780342948s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 19:55:03.349267607 (2h28m57.780347738s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:55:03.706628016 (2h28m58.137708157s) [upload=2633]: Done uploading segments... Aug 8 19:55:03.706648335 (2h28m58.137728466s) [upload=2633]: Upload finished. err: <nil> Duration: 6.948878728s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..................XX...........X..X.....X...................] duration: 1.832794194s FAIL (2025-08-08 19:57:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.832821998s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.......X.........................X......X..X........X..X....] duration: 5.674397768s FAIL (2025-08-08 19:57:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 8 19:55:00.833666684 (2h28m55.264746815s) [upload=2633]: Starting upload Aug 8 19:55:00.833712762 (2h28m55.264792893s) [upload=2633]: Done starting upload Aug 8 19:55:00.833850435 (2h28m55.264930567s) [upload=2633]: Uploading segments... Aug 8 19:55:00.833941379 (2h28m55.26502151s) [upload=2633]: Got next segment. Inline: false Aug 8 19:55:00.833971026 (2h28m55.265051157s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:55:00.833975494 (2h28m55.265055625s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:55:01.291048271 (2h28m55.722128422s) [seg_pos={0 0}, upload=2633]: Begin upload segment... Aug 8 19:55:01.291099119 (2h28m55.72217926s) [seg_pos={0 0}, upload=2633]: Done begin upload segment. Aug 8 19:55:01.291114558 (2h28m55.722194699s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291122303 (2h28m55.722202444s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291167038 (2h28m55.722247179s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291221713 (2h28m55.722301864s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291629884 (2h28m55.722710025s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291893599 (2h28m55.72297373s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292115904 (2h28m55.723196035s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292343419 (2h28m55.72342355s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292698308 (2h28m55.723778439s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292952555 (2h28m55.724032686s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293153248 (2h28m55.724233379s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293351769 (2h28m55.7244319s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293558013 (2h28m55.724638144s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293872395 (2h28m55.724952526s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294152331 (2h28m55.725232462s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294364987 (2h28m55.725445118s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294571552 (2h28m55.725651683s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294770914 (2h28m55.725851045s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:02.390230402 (2h28m56.821310533s) [upload=2633]: Next returned nil segment Aug 8 19:55:02.390254929 (2h28m56.82133506s) [upload=2633]: Waiting for error group managing segments... Aug 8 19:55:02.704831411 (2h28m57.135911542s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.725613002 (2h28m57.156693143s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.732816184 (2h28m57.163896315s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.765105813 (2h28m57.196185944s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.791704804 (2h28m57.222784935s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.249195771 (2h28m57.680275902s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.259212215 (2h28m57.690292346s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.276265503 (2h28m57.707345644s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.320733273 (2h28m57.751813404s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.325235506 (2h28m57.756315637s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.344273601 (2h28m57.775353732s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.345197439 (2h28m57.77627757s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.346818691 (2h28m57.777898822s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348769443 (2h28m57.779849584s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348782919 (2h28m57.77986305s) [seg_pos={0 0}, upload=2633]: Segment reached optimal threshold of 14 pieces. Aug 8 19:55:03.348897478 (2h28m57.779977599s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pz6ZrFzAdLySCxtFhbotfPLiA4nSmvhp5uaRAJQgSc7DUgmap): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.348957924 (2h28m57.780038055s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349014682 (2h28m57.780094813s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349105597 (2h28m57.780185728s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126g75XgAyFYcgnaibseqoGiz7cK6z3n6gPMcu9TrdjuZUYEHnZ): protocol: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection Aug 8 19:55:03.349162045 (2h28m57.780242176s) [seg_pos={0 0}, upload=2633]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 19:55:03.349262817 (2h28m57.780342948s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 19:55:03.349267607 (2h28m57.780347738s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:55:03.706628016 (2h28m58.137708157s) [upload=2633]: Done uploading segments... Aug 8 19:55:03.706648335 (2h28m58.137728466s) [upload=2633]: Upload finished. err: <nil> Duration: 5.674424409s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [........X.........................X......X..X........X..X...] duration: 6.063085896s FAIL (2025-08-08 19:56:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 8 19:55:00.833666684 (2h28m55.264746815s) [upload=2633]: Starting upload Aug 8 19:55:00.833712762 (2h28m55.264792893s) [upload=2633]: Done starting upload Aug 8 19:55:00.833850435 (2h28m55.264930567s) [upload=2633]: Uploading segments... Aug 8 19:55:00.833941379 (2h28m55.26502151s) [upload=2633]: Got next segment. Inline: false Aug 8 19:55:00.833971026 (2h28m55.265051157s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:55:00.833975494 (2h28m55.265055625s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:55:01.291048271 (2h28m55.722128422s) [seg_pos={0 0}, upload=2633]: Begin upload segment... Aug 8 19:55:01.291099119 (2h28m55.72217926s) [seg_pos={0 0}, upload=2633]: Done begin upload segment. Aug 8 19:55:01.291114558 (2h28m55.722194699s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291122303 (2h28m55.722202444s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291167038 (2h28m55.722247179s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291221713 (2h28m55.722301864s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291629884 (2h28m55.722710025s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291893599 (2h28m55.72297373s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292115904 (2h28m55.723196035s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292343419 (2h28m55.72342355s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292698308 (2h28m55.723778439s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292952555 (2h28m55.724032686s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293153248 (2h28m55.724233379s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293351769 (2h28m55.7244319s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293558013 (2h28m55.724638144s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293872395 (2h28m55.724952526s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294152331 (2h28m55.725232462s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294364987 (2h28m55.725445118s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294571552 (2h28m55.725651683s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294770914 (2h28m55.725851045s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:02.390230402 (2h28m56.821310533s) [upload=2633]: Next returned nil segment Aug 8 19:55:02.390254929 (2h28m56.82133506s) [upload=2633]: Waiting for error group managing segments... Aug 8 19:55:02.704831411 (2h28m57.135911542s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.725613002 (2h28m57.156693143s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.732816184 (2h28m57.163896315s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.765105813 (2h28m57.196185944s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.791704804 (2h28m57.222784935s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.249195771 (2h28m57.680275902s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.259212215 (2h28m57.690292346s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.276265503 (2h28m57.707345644s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.320733273 (2h28m57.751813404s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.325235506 (2h28m57.756315637s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.344273601 (2h28m57.775353732s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.345197439 (2h28m57.77627757s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.346818691 (2h28m57.777898822s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348769443 (2h28m57.779849584s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348782919 (2h28m57.77986305s) [seg_pos={0 0}, upload=2633]: Segment reached optimal threshold of 14 pieces. Aug 8 19:55:03.348897478 (2h28m57.779977599s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pz6ZrFzAdLySCxtFhbotfPLiA4nSmvhp5uaRAJQgSc7DUgmap): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.348957924 (2h28m57.780038055s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349014682 (2h28m57.780094813s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349105597 (2h28m57.780185728s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126g75XgAyFYcgnaibseqoGiz7cK6z3n6gPMcu9TrdjuZUYEHnZ): protocol: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection Aug 8 19:55:03.349162045 (2h28m57.780242176s) [seg_pos={0 0}, upload=2633]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 19:55:03.349262817 (2h28m57.780342948s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 19:55:03.349267607 (2h28m57.780347738s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:55:03.706628016 (2h28m58.137708157s) [upload=2633]: Done uploading segments... Aug 8 19:55:03.706648335 (2h28m58.137728466s) [upload=2633]: Upload finished. err: <nil> Duration: 6.063128647s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...................XX...........X..X.....X..................] duration: 1.868924221s FAIL (2025-08-08 19:56:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.868966782s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.........X.........................X......X..X........X..X..] duration: 5.99520905s FAIL (2025-08-08 19:56:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 8 19:55:00.833666684 (2h28m55.264746815s) [upload=2633]: Starting upload Aug 8 19:55:00.833712762 (2h28m55.264792893s) [upload=2633]: Done starting upload Aug 8 19:55:00.833850435 (2h28m55.264930567s) [upload=2633]: Uploading segments... Aug 8 19:55:00.833941379 (2h28m55.26502151s) [upload=2633]: Got next segment. Inline: false Aug 8 19:55:00.833971026 (2h28m55.265051157s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:55:00.833975494 (2h28m55.265055625s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:55:01.291048271 (2h28m55.722128422s) [seg_pos={0 0}, upload=2633]: Begin upload segment... Aug 8 19:55:01.291099119 (2h28m55.72217926s) [seg_pos={0 0}, upload=2633]: Done begin upload segment. Aug 8 19:55:01.291114558 (2h28m55.722194699s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291122303 (2h28m55.722202444s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291167038 (2h28m55.722247179s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291221713 (2h28m55.722301864s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291629884 (2h28m55.722710025s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291893599 (2h28m55.72297373s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292115904 (2h28m55.723196035s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292343419 (2h28m55.72342355s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292698308 (2h28m55.723778439s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292952555 (2h28m55.724032686s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293153248 (2h28m55.724233379s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293351769 (2h28m55.7244319s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293558013 (2h28m55.724638144s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293872395 (2h28m55.724952526s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294152331 (2h28m55.725232462s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294364987 (2h28m55.725445118s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294571552 (2h28m55.725651683s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294770914 (2h28m55.725851045s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:02.390230402 (2h28m56.821310533s) [upload=2633]: Next returned nil segment Aug 8 19:55:02.390254929 (2h28m56.82133506s) [upload=2633]: Waiting for error group managing segments... Aug 8 19:55:02.704831411 (2h28m57.135911542s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.725613002 (2h28m57.156693143s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.732816184 (2h28m57.163896315s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.765105813 (2h28m57.196185944s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.791704804 (2h28m57.222784935s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.249195771 (2h28m57.680275902s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.259212215 (2h28m57.690292346s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.276265503 (2h28m57.707345644s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.320733273 (2h28m57.751813404s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.325235506 (2h28m57.756315637s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.344273601 (2h28m57.775353732s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.345197439 (2h28m57.77627757s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.346818691 (2h28m57.777898822s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348769443 (2h28m57.779849584s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348782919 (2h28m57.77986305s) [seg_pos={0 0}, upload=2633]: Segment reached optimal threshold of 14 pieces. Aug 8 19:55:03.348897478 (2h28m57.779977599s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pz6ZrFzAdLySCxtFhbotfPLiA4nSmvhp5uaRAJQgSc7DUgmap): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.348957924 (2h28m57.780038055s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349014682 (2h28m57.780094813s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349105597 (2h28m57.780185728s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126g75XgAyFYcgnaibseqoGiz7cK6z3n6gPMcu9TrdjuZUYEHnZ): protocol: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection Aug 8 19:55:03.349162045 (2h28m57.780242176s) [seg_pos={0 0}, upload=2633]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 19:55:03.349262817 (2h28m57.780342948s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 19:55:03.349267607 (2h28m57.780347738s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:55:03.706628016 (2h28m58.137708157s) [upload=2633]: Done uploading segments... Aug 8 19:55:03.706648335 (2h28m58.137728466s) [upload=2633]: Upload finished. err: <nil> Duration: 5.995233778s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [....................XX...........X..X.....X.................] duration: 1.924709305s FAIL (2025-08-08 19:56:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.924741317s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..........X.........................X......X..X........X..X.] duration: 5.921740693s FAIL (2025-08-08 19:55:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 8 19:55:00.833666684 (2h28m55.264746815s) [upload=2633]: Starting upload Aug 8 19:55:00.833712762 (2h28m55.264792893s) [upload=2633]: Done starting upload Aug 8 19:55:00.833850435 (2h28m55.264930567s) [upload=2633]: Uploading segments... Aug 8 19:55:00.833941379 (2h28m55.26502151s) [upload=2633]: Got next segment. Inline: false Aug 8 19:55:00.833971026 (2h28m55.265051157s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:55:00.833975494 (2h28m55.265055625s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:55:01.291048271 (2h28m55.722128422s) [seg_pos={0 0}, upload=2633]: Begin upload segment... Aug 8 19:55:01.291099119 (2h28m55.72217926s) [seg_pos={0 0}, upload=2633]: Done begin upload segment. Aug 8 19:55:01.291114558 (2h28m55.722194699s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291122303 (2h28m55.722202444s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291167038 (2h28m55.722247179s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291221713 (2h28m55.722301864s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291629884 (2h28m55.722710025s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291893599 (2h28m55.72297373s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292115904 (2h28m55.723196035s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292343419 (2h28m55.72342355s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292698308 (2h28m55.723778439s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292952555 (2h28m55.724032686s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293153248 (2h28m55.724233379s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293351769 (2h28m55.7244319s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293558013 (2h28m55.724638144s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293872395 (2h28m55.724952526s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294152331 (2h28m55.725232462s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294364987 (2h28m55.725445118s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294571552 (2h28m55.725651683s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294770914 (2h28m55.725851045s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:02.390230402 (2h28m56.821310533s) [upload=2633]: Next returned nil segment Aug 8 19:55:02.390254929 (2h28m56.82133506s) [upload=2633]: Waiting for error group managing segments... Aug 8 19:55:02.704831411 (2h28m57.135911542s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.725613002 (2h28m57.156693143s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.732816184 (2h28m57.163896315s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.765105813 (2h28m57.196185944s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.791704804 (2h28m57.222784935s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.249195771 (2h28m57.680275902s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.259212215 (2h28m57.690292346s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.276265503 (2h28m57.707345644s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.320733273 (2h28m57.751813404s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.325235506 (2h28m57.756315637s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.344273601 (2h28m57.775353732s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.345197439 (2h28m57.77627757s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.346818691 (2h28m57.777898822s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348769443 (2h28m57.779849584s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348782919 (2h28m57.77986305s) [seg_pos={0 0}, upload=2633]: Segment reached optimal threshold of 14 pieces. Aug 8 19:55:03.348897478 (2h28m57.779977599s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pz6ZrFzAdLySCxtFhbotfPLiA4nSmvhp5uaRAJQgSc7DUgmap): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.348957924 (2h28m57.780038055s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349014682 (2h28m57.780094813s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349105597 (2h28m57.780185728s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126g75XgAyFYcgnaibseqoGiz7cK6z3n6gPMcu9TrdjuZUYEHnZ): protocol: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection Aug 8 19:55:03.349162045 (2h28m57.780242176s) [seg_pos={0 0}, upload=2633]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 19:55:03.349262817 (2h28m57.780342948s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 19:55:03.349267607 (2h28m57.780347738s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:55:03.706628016 (2h28m58.137708157s) [upload=2633]: Done uploading segments... Aug 8 19:55:03.706648335 (2h28m58.137728466s) [upload=2633]: Upload finished. err: <nil> Duration: 5.921764858s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...........X.........................X......X..X........X..X] duration: 4.239734819s FAIL (2025-08-08 19:55:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 8 19:55:00.833666684 (2h28m55.264746815s) [upload=2633]: Starting upload Aug 8 19:55:00.833712762 (2h28m55.264792893s) [upload=2633]: Done starting upload Aug 8 19:55:00.833850435 (2h28m55.264930567s) [upload=2633]: Uploading segments... Aug 8 19:55:00.833941379 (2h28m55.26502151s) [upload=2633]: Got next segment. Inline: false Aug 8 19:55:00.833971026 (2h28m55.265051157s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:55:00.833975494 (2h28m55.265055625s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:55:01.291048271 (2h28m55.722128422s) [seg_pos={0 0}, upload=2633]: Begin upload segment... Aug 8 19:55:01.291099119 (2h28m55.72217926s) [seg_pos={0 0}, upload=2633]: Done begin upload segment. Aug 8 19:55:01.291114558 (2h28m55.722194699s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291122303 (2h28m55.722202444s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291167038 (2h28m55.722247179s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291221713 (2h28m55.722301864s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291629884 (2h28m55.722710025s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.291893599 (2h28m55.72297373s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292115904 (2h28m55.723196035s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292343419 (2h28m55.72342355s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292698308 (2h28m55.723778439s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.292952555 (2h28m55.724032686s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293153248 (2h28m55.724233379s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293351769 (2h28m55.7244319s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293558013 (2h28m55.724638144s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.293872395 (2h28m55.724952526s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294152331 (2h28m55.725232462s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294364987 (2h28m55.725445118s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294571552 (2h28m55.725651683s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:01.294770914 (2h28m55.725851045s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Uploading piece... Aug 8 19:55:02.390230402 (2h28m56.821310533s) [upload=2633]: Next returned nil segment Aug 8 19:55:02.390254929 (2h28m56.82133506s) [upload=2633]: Waiting for error group managing segments... Aug 8 19:55:02.704831411 (2h28m57.135911542s) [noise=true , address=79.127.205.233:4631 , piece_id=RECLY62WGSZEPD7QWQ5PYKLEEJSUVRWF6OERYHL4RJU7I4QZ3IGA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.725613002 (2h28m57.156693143s) [noise=true , address=79.127.205.233:4638 , piece_id=T276P6EOTARNWLM2YQ3OEKFXVQCVGW7RQBEHWSY2JF4KO5YFS4PQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.732816184 (2h28m57.163896315s) [noise=true , address=64.49.13.154:4927 , piece_id=QCMU6OPBSQOMQG3JMXF2NNW5IE4EWTWKPEIEXVSBFRTE6X7U3MEA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.765105813 (2h28m57.196185944s) [noise=true , address=64.49.13.169:4714 , piece_id=GUERBVFND7EIQBTI2W3XXETUBAPJOXCEBST45JQXLUF6XE6DQ2XQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:02.791704804 (2h28m57.222784935s) [noise=true , address=64.49.13.154:4929 , piece_id=2HKXI4F77TOVYTK2LNMKLTRS7NAMTM4ASY26KDLTIL54B2EGXZQQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.249195771 (2h28m57.680275902s) [noise=true , address=104.36.82.58:4287 , piece_id=3XHQI2TDWIKVJ4H3TJAE5AM3GFTMIDGD27LRJKU7JZIKAHJMFTJA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.259212215 (2h28m57.690292346s) [noise=true , address=104.36.82.43:4851 , piece_id=S3ZXQONIIH4LSNGUTUB3IGZOS5WEHIAZPR2O4VFJW2MC23KE5RSQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.276265503 (2h28m57.707345644s) [noise=true , address=104.36.82.3:4786 , piece_id=5CHAOGNJ7255ZQPK4JUEBG557WMDP6J5DRZXMXSAL6BOSNPCJUFQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.320733273 (2h28m57.751813404s) [noise=true , address=104.36.82.37:4673 , piece_id=N2U3BCYJ2RLVJC5K65OWM2FGCLRACMQB33P4LE2R5RPWVPKDPR6A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.325235506 (2h28m57.756315637s) [noise=true , address=104.36.82.62:4420 , piece_id=DP5LG7T35W66SQ4MYGGOHJUT32QBQZPBFH7XUDT2CG5ZBVK3SB4A, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.344273601 (2h28m57.775353732s) [noise=true , address=104.36.82.59:4324 , piece_id=GQTBVCNIXB57NPRN2AZD2ZZ4HC3NBW2F7CQHK7S4S2EB7HFZ2SGQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.345197439 (2h28m57.77627757s) [noise=true , address=104.36.82.61:4390 , piece_id=WSFZJWSM2EICMIMMD7VDL7HH2QKFG3NZEAM447DFEFSTWOZOLXAA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.346818691 (2h28m57.777898822s) [noise=true , address=45.91.116.14:4211 , piece_id=7EKTSGANM5KV5QLAHZPLXQU2624RHGCXATCKCW73L4UULQ53T5PA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348769443 (2h28m57.779849584s) [noise=true , address=104.36.82.36:4640 , piece_id=WJVCJCBOP3X6CPFPO6DPSQ3XVCZB5R3GFG6WAOK3FDLVJC3PH3LQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: <nil> Aug 8 19:55:03.348782919 (2h28m57.77986305s) [seg_pos={0 0}, upload=2633]: Segment reached optimal threshold of 14 pieces. Aug 8 19:55:03.348897478 (2h28m57.779977599s) [noise=true , address=104.36.82.56:4253 , piece_id=4SC2XAGLEW7BFFMRQWNC3FTRDM2L35KMYNQAW3TU4PB2EXRYHORA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Pz6ZrFzAdLySCxtFhbotfPLiA4nSmvhp5uaRAJQgSc7DUgmap): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.348957924 (2h28m57.780038055s) [noise=true , address=104.36.82.34:4569 , piece_id=HKWYNKBOJOSLLX2POHDZM5E65XOHOENS5XLCYCWFQXAR4SHK5JIQ, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349014682 (2h28m57.780094813s) [noise=true , address=104.36.82.60:4342 , piece_id=SX3EP7FTZ2TTFWTQGP4U45J5POBEFS5AT5RTD7GDWDH45RFRXLNA, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 8 19:55:03.349105597 (2h28m57.780185728s) [noise=true , address=104.36.82.47:4539 , piece_id=HZRNC6I467RKROK6ZWBVIZCOQJOUISO3XVCRTWD4PMMHL4MJVI5Q, seg_pos={0 0}, upload=2633]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126g75XgAyFYcgnaibseqoGiz7cK6z3n6gPMcu9TrdjuZUYEHnZ): protocol: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59144->104.36.82.47:4539: use of closed network connection Aug 8 19:55:03.349162045 (2h28m57.780242176s) [seg_pos={0 0}, upload=2633]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 19:55:03.349262817 (2h28m57.780342948s) [upload=2633]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 19:55:03.349267607 (2h28m57.780347738s) [upload=2633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:55:03.706628016 (2h28m58.137708157s) [upload=2633]: Done uploading segments... Aug 8 19:55:03.706648335 (2h28m58.137728466s) [upload=2633]: Upload finished. err: <nil> Duration: 4.239760239s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.....................XX...........X..X.....X................] duration: 1.898749646s FAIL (2025-08-08 19:55:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.898771809s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [............X.........................X......X..X........X..] duration: 5.947327047s FAIL (2025-08-08 19:54:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 75b595278a7c47bd0d5292651ccaa53912616d6813d0b2edfe0cf1ade3648b67 != before 98ffb74f149b2e92ebd8e93a7dd3c1e88826405939ee11c6728a57d7d6d79905 ======LOGS====== Aug 8 19:52:37.719873114 (2h26m32.150953245s) [upload=2592]: Starting upload Aug 8 19:52:37.719919011 (2h26m32.150999142s) [upload=2592]: Done starting upload Aug 8 19:52:37.720036066 (2h26m32.151116257s) [upload=2592]: Uploading segments... Aug 8 19:52:37.720146838 (2h26m32.151227029s) [upload=2592]: Got next segment. Inline: false Aug 8 19:52:37.720213485 (2h26m32.151293686s) [upload=2592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:52:37.720222762 (2h26m32.151302953s) [upload=2592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:52:38.174292859 (2h26m32.60537299s) [seg_pos={0 0}, upload=2592]: Begin upload segment... Aug 8 19:52:38.174338907 (2h26m32.605419038s) [seg_pos={0 0}, upload=2592]: Done begin upload segment. Aug 8 19:52:38.174355057 (2h26m32.605435189s) [noise=true , address=64.49.13.27:4961 , piece_id=RLEDVUSBWUD45CJSPAAUI55W454Z3R2Z36FVBBKTEZRRCM66TQDA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.174368754 (2h26m32.605448885s) [noise=true , address=104.36.82.39:4752 , piece_id=UR5CF3AAMVIY23LFOWZGUXJ5OSP2PFMM2FCZPTTRAPNZPC54UNIA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.174881175 (2h26m32.605961306s) [noise=true , address=104.36.82.4:4817 , piece_id=GVXESXWUXLSGLDXHIQCOGLAYCSYLN6RKZ62OTR2CKYKOBCSJ2VRQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.174900551 (2h26m32.605980682s) [noise=true , address=45.91.116.7:4023 , piece_id=HNIYSD6PGHD4HQET5LQNZSGMQDKRVQ436U2E5WHXMQ6VH5HFVW5Q, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175215364 (2h26m32.606295495s) [noise=true , address=64.49.13.137:4495 , piece_id=2HRMMNHSBXOLQ5Q2C2ISWWK4LX74VIK5ZKGTOZ3EXF7A4RCXMGPQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175219712 (2h26m32.606299843s) [noise=true , address=64.49.13.170:4718 , piece_id=ARME5TI4PRSUPRRJZ2RROZRAP6H2KV44INELLD4EU42PKF4KAJFQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175506962 (2h26m32.606587093s) [noise=true , address=64.49.13.169:4708 , piece_id=W5YFSGNCM663W3CHXKZ5JHNQC5HT7BCM4T42746M3JSBWSWUOSIA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175746721 (2h26m32.606826842s) [noise=true , address=79.127.205.235:4663 , piece_id=NSILXCWTRRF3Y2Z76ELXSU5LBDBY355NL37MCQFQI6PFWURYNDOQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175990407 (2h26m32.607070538s) [noise=true , address=104.36.82.13:4205 , piece_id=4S4HZM5EJHQDE6SI7UTOMOBBQ556MFSIAQXFQEE7KSQOTE664NOA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.176235245 (2h26m32.607315377s) [noise=true , address=104.36.82.34:4546 , piece_id=D5VNYIUFPOACPNRIWXJNOVKUVCXEBHSGOMBQPTXO5TBUUFNPIITQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.176502587 (2h26m32.607582718s) [noise=true , address=79.127.201.214:4307 , piece_id=I7DNFJ6TOCYNUEKQ3BGXTPDEVZEKFNYH4ONHQ7S77N47FKWMJVQQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.176733388 (2h26m32.607813509s) [noise=true , address=104.36.82.47:4552 , piece_id=KN7M4D4Q4HSREC7RDABR4MKN5Y4H6PFEIGG3W6ILUJZWS4FGHULA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.176977596 (2h26m32.608057727s) [noise=true , address=64.49.13.170:4725 , piece_id=JJZ6SSURGVZALEEZGNFL3443XWKBD5MYXKHFD7F5DT3EJDFRVMMQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.177340149 (2h26m32.60842028s) [noise=true , address=104.36.82.37:4684 , piece_id=2L7CSYBHUS2LNMRS5JWTVUTXGZA6WOWV5GIDOK2SNDFXSXJT4ZEA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.178155700 (2h26m32.609235851s) [noise=true , address=104.36.82.62:4432 , piece_id=HUASG5J2NFKB62SAT2KQS7AJ4QROII52PRF75FM4GV5FBQJJBWJQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.178505939 (2h26m32.60958607s) [noise=true , address=104.36.82.60:4365 , piece_id=TEGQJHMEBZSBARVJKIORYADUMEAEZTA4POPY4VRNFSD25UNMFOZA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.178775044 (2h26m32.609855176s) [noise=true , address=104.36.82.61:4383 , piece_id=744ODK6G6U6UJFNZUR4S6NL3DHHL2OOGGE3BIGXTUHUZ7TVY5RVA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.179015054 (2h26m32.610095185s) [noise=true , address=104.36.82.36:4629 , piece_id=POYO6XNK2NOZRQNMTM23LNFIM54C6UCTMAYPV2CG4Y7UKTRY2CRA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:39.280548684 (2h26m33.711628815s) [upload=2592]: Next returned nil segment Aug 8 19:52:39.280567661 (2h26m33.711647792s) [upload=2592]: Waiting for error group managing segments... Aug 8 19:52:39.558309056 (2h26m33.989389187s) [noise=true , address=79.127.205.235:4663 , piece_id=NSILXCWTRRF3Y2Z76ELXSU5LBDBY355NL37MCQFQI6PFWURYNDOQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.602003566 (2h26m34.033083697s) [noise=true , address=64.49.13.137:4495 , piece_id=2HRMMNHSBXOLQ5Q2C2ISWWK4LX74VIK5ZKGTOZ3EXF7A4RCXMGPQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.606090526 (2h26m34.037170657s) [noise=true , address=64.49.13.169:4708 , piece_id=W5YFSGNCM663W3CHXKZ5JHNQC5HT7BCM4T42746M3JSBWSWUOSIA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.653486648 (2h26m34.084566789s) [noise=true , address=64.49.13.170:4718 , piece_id=ARME5TI4PRSUPRRJZ2RROZRAP6H2KV44INELLD4EU42PKF4KAJFQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.661305568 (2h26m34.092385699s) [noise=true , address=64.49.13.27:4961 , piece_id=RLEDVUSBWUD45CJSPAAUI55W454Z3R2Z36FVBBKTEZRRCM66TQDA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.740934219 (2h26m34.17201435s) [noise=true , address=64.49.13.170:4725 , piece_id=JJZ6SSURGVZALEEZGNFL3443XWKBD5MYXKHFD7F5DT3EJDFRVMMQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.079296590 (2h26m34.510376721s) [noise=true , address=79.127.201.214:4307 , piece_id=I7DNFJ6TOCYNUEKQ3BGXTPDEVZEKFNYH4ONHQ7S77N47FKWMJVQQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.126313677 (2h26m34.557393828s) [noise=true , address=104.36.82.34:4546 , piece_id=D5VNYIUFPOACPNRIWXJNOVKUVCXEBHSGOMBQPTXO5TBUUFNPIITQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.148317597 (2h26m34.579397728s) [noise=true , address=104.36.82.60:4365 , piece_id=TEGQJHMEBZSBARVJKIORYADUMEAEZTA4POPY4VRNFSD25UNMFOZA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.193741135 (2h26m34.624821266s) [noise=true , address=104.36.82.36:4629 , piece_id=POYO6XNK2NOZRQNMTM23LNFIM54C6UCTMAYPV2CG4Y7UKTRY2CRA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.195908390 (2h26m34.626988521s) [noise=true , address=104.36.82.62:4432 , piece_id=HUASG5J2NFKB62SAT2KQS7AJ4QROII52PRF75FM4GV5FBQJJBWJQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.221702853 (2h26m34.652782984s) [noise=true , address=104.36.82.61:4383 , piece_id=744ODK6G6U6UJFNZUR4S6NL3DHHL2OOGGE3BIGXTUHUZ7TVY5RVA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.246878160 (2h26m34.677958291s) [noise=true , address=104.36.82.13:4205 , piece_id=4S4HZM5EJHQDE6SI7UTOMOBBQ556MFSIAQXFQEE7KSQOTE664NOA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.303043180 (2h26m34.734123301s) [noise=true , address=45.91.116.7:4023 , piece_id=HNIYSD6PGHD4HQET5LQNZSGMQDKRVQ436U2E5WHXMQ6VH5HFVW5Q, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.303068047 (2h26m34.734148178s) [seg_pos={0 0}, upload=2592]: Segment reached optimal threshold of 14 pieces. Aug 8 19:52:40.303294891 (2h26m34.734375012s) [noise=true , address=104.36.82.39:4752 , piece_id=UR5CF3AAMVIY23LFOWZGUXJ5OSP2PFMM2FCZPTTRAPNZPC54UNIA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qoB7SaK4p6GwyHAKnheGGuMvQFzA3cerZL5nx7KnpazomyCTT): protocol: expected piece hash; context canceled; EOF Aug 8 19:52:40.303400803 (2h26m34.734480934s) [noise=true , address=104.36.82.37:4684 , piece_id=2L7CSYBHUS2LNMRS5JWTVUTXGZA6WOWV5GIDOK2SNDFXSXJT4ZEA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123rwT3AmQR5nrvjoo6fgKBBJaKVWJHkJ6FtLnoNYs2AxakoDZC): protocol: read tcp 188.166.225.170:51968->104.36.82.37:4684: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 19:52:40.303468473 (2h26m34.734548594s) [noise=true , address=104.36.82.47:4552 , piece_id=KN7M4D4Q4HSREC7RDABR4MKN5Y4H6PFEIGG3W6ILUJZWS4FGHULA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hoXgBFoGKKknrobbqfArxNhrsiUHKiiVZGWCnvxDSgBcae8gw): protocol: rpc: dial tcp 104.36.82.47:4552: operation was canceled; context canceled Aug 8 19:52:40.303493000 (2h26m34.734573131s) [noise=true , address=104.36.82.4:4817 , piece_id=GVXESXWUXLSGLDXHIQCOGLAYCSYLN6RKZ62OTR2CKYKOBCSJ2VRQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: read tcp 188.166.225.170:36592->104.36.82.4:4817: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 19:52:40.303518960 (2h26m34.734599091s) [seg_pos={0 0}, upload=2592]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 19:52:40.303590456 (2h26m34.734670587s) [upload=2592]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 19:52:40.303595266 (2h26m34.734675397s) [upload=2592]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:52:40.778365243 (2h26m35.209445364s) [upload=2592]: Done uploading segments... Aug 8 19:52:40.778383587 (2h26m35.209463718s) [upload=2592]: Upload finished. err: <nil> Duration: 5.947362184s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [......................XX...........X..X.....X...............] duration: 1.901359797s FAIL (2025-08-08 19:54:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.901385416s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.......................XX...........X..X.....X..............] duration: 1.834610981s FAIL (2025-08-08 19:53:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.834637601s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.............X.........................X......X..X........X.] duration: 5.882092575s FAIL (2025-08-08 19:53:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 75b595278a7c47bd0d5292651ccaa53912616d6813d0b2edfe0cf1ade3648b67 != before 98ffb74f149b2e92ebd8e93a7dd3c1e88826405939ee11c6728a57d7d6d79905 ======LOGS====== Aug 8 19:52:37.719873114 (2h26m32.150953245s) [upload=2592]: Starting upload Aug 8 19:52:37.719919011 (2h26m32.150999142s) [upload=2592]: Done starting upload Aug 8 19:52:37.720036066 (2h26m32.151116257s) [upload=2592]: Uploading segments... Aug 8 19:52:37.720146838 (2h26m32.151227029s) [upload=2592]: Got next segment. Inline: false Aug 8 19:52:37.720213485 (2h26m32.151293686s) [upload=2592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:52:37.720222762 (2h26m32.151302953s) [upload=2592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:52:38.174292859 (2h26m32.60537299s) [seg_pos={0 0}, upload=2592]: Begin upload segment... Aug 8 19:52:38.174338907 (2h26m32.605419038s) [seg_pos={0 0}, upload=2592]: Done begin upload segment. Aug 8 19:52:38.174355057 (2h26m32.605435189s) [noise=true , address=64.49.13.27:4961 , piece_id=RLEDVUSBWUD45CJSPAAUI55W454Z3R2Z36FVBBKTEZRRCM66TQDA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.174368754 (2h26m32.605448885s) [noise=true , address=104.36.82.39:4752 , piece_id=UR5CF3AAMVIY23LFOWZGUXJ5OSP2PFMM2FCZPTTRAPNZPC54UNIA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.174881175 (2h26m32.605961306s) [noise=true , address=104.36.82.4:4817 , piece_id=GVXESXWUXLSGLDXHIQCOGLAYCSYLN6RKZ62OTR2CKYKOBCSJ2VRQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.174900551 (2h26m32.605980682s) [noise=true , address=45.91.116.7:4023 , piece_id=HNIYSD6PGHD4HQET5LQNZSGMQDKRVQ436U2E5WHXMQ6VH5HFVW5Q, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175215364 (2h26m32.606295495s) [noise=true , address=64.49.13.137:4495 , piece_id=2HRMMNHSBXOLQ5Q2C2ISWWK4LX74VIK5ZKGTOZ3EXF7A4RCXMGPQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175219712 (2h26m32.606299843s) [noise=true , address=64.49.13.170:4718 , piece_id=ARME5TI4PRSUPRRJZ2RROZRAP6H2KV44INELLD4EU42PKF4KAJFQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175506962 (2h26m32.606587093s) [noise=true , address=64.49.13.169:4708 , piece_id=W5YFSGNCM663W3CHXKZ5JHNQC5HT7BCM4T42746M3JSBWSWUOSIA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175746721 (2h26m32.606826842s) [noise=true , address=79.127.205.235:4663 , piece_id=NSILXCWTRRF3Y2Z76ELXSU5LBDBY355NL37MCQFQI6PFWURYNDOQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175990407 (2h26m32.607070538s) [noise=true , address=104.36.82.13:4205 , piece_id=4S4HZM5EJHQDE6SI7UTOMOBBQ556MFSIAQXFQEE7KSQOTE664NOA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.176235245 (2h26m32.607315377s) [noise=true , address=104.36.82.34:4546 , piece_id=D5VNYIUFPOACPNRIWXJNOVKUVCXEBHSGOMBQPTXO5TBUUFNPIITQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.176502587 (2h26m32.607582718s) [noise=true , address=79.127.201.214:4307 , piece_id=I7DNFJ6TOCYNUEKQ3BGXTPDEVZEKFNYH4ONHQ7S77N47FKWMJVQQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.176733388 (2h26m32.607813509s) [noise=true , address=104.36.82.47:4552 , piece_id=KN7M4D4Q4HSREC7RDABR4MKN5Y4H6PFEIGG3W6ILUJZWS4FGHULA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.176977596 (2h26m32.608057727s) [noise=true , address=64.49.13.170:4725 , piece_id=JJZ6SSURGVZALEEZGNFL3443XWKBD5MYXKHFD7F5DT3EJDFRVMMQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.177340149 (2h26m32.60842028s) [noise=true , address=104.36.82.37:4684 , piece_id=2L7CSYBHUS2LNMRS5JWTVUTXGZA6WOWV5GIDOK2SNDFXSXJT4ZEA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.178155700 (2h26m32.609235851s) [noise=true , address=104.36.82.62:4432 , piece_id=HUASG5J2NFKB62SAT2KQS7AJ4QROII52PRF75FM4GV5FBQJJBWJQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.178505939 (2h26m32.60958607s) [noise=true , address=104.36.82.60:4365 , piece_id=TEGQJHMEBZSBARVJKIORYADUMEAEZTA4POPY4VRNFSD25UNMFOZA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.178775044 (2h26m32.609855176s) [noise=true , address=104.36.82.61:4383 , piece_id=744ODK6G6U6UJFNZUR4S6NL3DHHL2OOGGE3BIGXTUHUZ7TVY5RVA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.179015054 (2h26m32.610095185s) [noise=true , address=104.36.82.36:4629 , piece_id=POYO6XNK2NOZRQNMTM23LNFIM54C6UCTMAYPV2CG4Y7UKTRY2CRA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:39.280548684 (2h26m33.711628815s) [upload=2592]: Next returned nil segment Aug 8 19:52:39.280567661 (2h26m33.711647792s) [upload=2592]: Waiting for error group managing segments... Aug 8 19:52:39.558309056 (2h26m33.989389187s) [noise=true , address=79.127.205.235:4663 , piece_id=NSILXCWTRRF3Y2Z76ELXSU5LBDBY355NL37MCQFQI6PFWURYNDOQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.602003566 (2h26m34.033083697s) [noise=true , address=64.49.13.137:4495 , piece_id=2HRMMNHSBXOLQ5Q2C2ISWWK4LX74VIK5ZKGTOZ3EXF7A4RCXMGPQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.606090526 (2h26m34.037170657s) [noise=true , address=64.49.13.169:4708 , piece_id=W5YFSGNCM663W3CHXKZ5JHNQC5HT7BCM4T42746M3JSBWSWUOSIA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.653486648 (2h26m34.084566789s) [noise=true , address=64.49.13.170:4718 , piece_id=ARME5TI4PRSUPRRJZ2RROZRAP6H2KV44INELLD4EU42PKF4KAJFQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.661305568 (2h26m34.092385699s) [noise=true , address=64.49.13.27:4961 , piece_id=RLEDVUSBWUD45CJSPAAUI55W454Z3R2Z36FVBBKTEZRRCM66TQDA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.740934219 (2h26m34.17201435s) [noise=true , address=64.49.13.170:4725 , piece_id=JJZ6SSURGVZALEEZGNFL3443XWKBD5MYXKHFD7F5DT3EJDFRVMMQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.079296590 (2h26m34.510376721s) [noise=true , address=79.127.201.214:4307 , piece_id=I7DNFJ6TOCYNUEKQ3BGXTPDEVZEKFNYH4ONHQ7S77N47FKWMJVQQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.126313677 (2h26m34.557393828s) [noise=true , address=104.36.82.34:4546 , piece_id=D5VNYIUFPOACPNRIWXJNOVKUVCXEBHSGOMBQPTXO5TBUUFNPIITQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.148317597 (2h26m34.579397728s) [noise=true , address=104.36.82.60:4365 , piece_id=TEGQJHMEBZSBARVJKIORYADUMEAEZTA4POPY4VRNFSD25UNMFOZA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.193741135 (2h26m34.624821266s) [noise=true , address=104.36.82.36:4629 , piece_id=POYO6XNK2NOZRQNMTM23LNFIM54C6UCTMAYPV2CG4Y7UKTRY2CRA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.195908390 (2h26m34.626988521s) [noise=true , address=104.36.82.62:4432 , piece_id=HUASG5J2NFKB62SAT2KQS7AJ4QROII52PRF75FM4GV5FBQJJBWJQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.221702853 (2h26m34.652782984s) [noise=true , address=104.36.82.61:4383 , piece_id=744ODK6G6U6UJFNZUR4S6NL3DHHL2OOGGE3BIGXTUHUZ7TVY5RVA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.246878160 (2h26m34.677958291s) [noise=true , address=104.36.82.13:4205 , piece_id=4S4HZM5EJHQDE6SI7UTOMOBBQ556MFSIAQXFQEE7KSQOTE664NOA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.303043180 (2h26m34.734123301s) [noise=true , address=45.91.116.7:4023 , piece_id=HNIYSD6PGHD4HQET5LQNZSGMQDKRVQ436U2E5WHXMQ6VH5HFVW5Q, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.303068047 (2h26m34.734148178s) [seg_pos={0 0}, upload=2592]: Segment reached optimal threshold of 14 pieces. Aug 8 19:52:40.303294891 (2h26m34.734375012s) [noise=true , address=104.36.82.39:4752 , piece_id=UR5CF3AAMVIY23LFOWZGUXJ5OSP2PFMM2FCZPTTRAPNZPC54UNIA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qoB7SaK4p6GwyHAKnheGGuMvQFzA3cerZL5nx7KnpazomyCTT): protocol: expected piece hash; context canceled; EOF Aug 8 19:52:40.303400803 (2h26m34.734480934s) [noise=true , address=104.36.82.37:4684 , piece_id=2L7CSYBHUS2LNMRS5JWTVUTXGZA6WOWV5GIDOK2SNDFXSXJT4ZEA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123rwT3AmQR5nrvjoo6fgKBBJaKVWJHkJ6FtLnoNYs2AxakoDZC): protocol: read tcp 188.166.225.170:51968->104.36.82.37:4684: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 19:52:40.303468473 (2h26m34.734548594s) [noise=true , address=104.36.82.47:4552 , piece_id=KN7M4D4Q4HSREC7RDABR4MKN5Y4H6PFEIGG3W6ILUJZWS4FGHULA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hoXgBFoGKKknrobbqfArxNhrsiUHKiiVZGWCnvxDSgBcae8gw): protocol: rpc: dial tcp 104.36.82.47:4552: operation was canceled; context canceled Aug 8 19:52:40.303493000 (2h26m34.734573131s) [noise=true , address=104.36.82.4:4817 , piece_id=GVXESXWUXLSGLDXHIQCOGLAYCSYLN6RKZ62OTR2CKYKOBCSJ2VRQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: read tcp 188.166.225.170:36592->104.36.82.4:4817: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 19:52:40.303518960 (2h26m34.734599091s) [seg_pos={0 0}, upload=2592]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 19:52:40.303590456 (2h26m34.734670587s) [upload=2592]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 19:52:40.303595266 (2h26m34.734675397s) [upload=2592]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:52:40.778365243 (2h26m35.209445364s) [upload=2592]: Done uploading segments... Aug 8 19:52:40.778383587 (2h26m35.209463718s) [upload=2592]: Upload finished. err: <nil> Duration: 5.882118466s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..............X.........................X......X..X........X] duration: 5.962068963s FAIL (2025-08-08 19:52:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 75b595278a7c47bd0d5292651ccaa53912616d6813d0b2edfe0cf1ade3648b67 != before 98ffb74f149b2e92ebd8e93a7dd3c1e88826405939ee11c6728a57d7d6d79905 ======LOGS====== Aug 8 19:52:37.719873114 (2h26m32.150953245s) [upload=2592]: Starting upload Aug 8 19:52:37.719919011 (2h26m32.150999142s) [upload=2592]: Done starting upload Aug 8 19:52:37.720036066 (2h26m32.151116257s) [upload=2592]: Uploading segments... Aug 8 19:52:37.720146838 (2h26m32.151227029s) [upload=2592]: Got next segment. Inline: false Aug 8 19:52:37.720213485 (2h26m32.151293686s) [upload=2592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:52:37.720222762 (2h26m32.151302953s) [upload=2592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:52:38.174292859 (2h26m32.60537299s) [seg_pos={0 0}, upload=2592]: Begin upload segment... Aug 8 19:52:38.174338907 (2h26m32.605419038s) [seg_pos={0 0}, upload=2592]: Done begin upload segment. Aug 8 19:52:38.174355057 (2h26m32.605435189s) [noise=true , address=64.49.13.27:4961 , piece_id=RLEDVUSBWUD45CJSPAAUI55W454Z3R2Z36FVBBKTEZRRCM66TQDA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.174368754 (2h26m32.605448885s) [noise=true , address=104.36.82.39:4752 , piece_id=UR5CF3AAMVIY23LFOWZGUXJ5OSP2PFMM2FCZPTTRAPNZPC54UNIA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.174881175 (2h26m32.605961306s) [noise=true , address=104.36.82.4:4817 , piece_id=GVXESXWUXLSGLDXHIQCOGLAYCSYLN6RKZ62OTR2CKYKOBCSJ2VRQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.174900551 (2h26m32.605980682s) [noise=true , address=45.91.116.7:4023 , piece_id=HNIYSD6PGHD4HQET5LQNZSGMQDKRVQ436U2E5WHXMQ6VH5HFVW5Q, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175215364 (2h26m32.606295495s) [noise=true , address=64.49.13.137:4495 , piece_id=2HRMMNHSBXOLQ5Q2C2ISWWK4LX74VIK5ZKGTOZ3EXF7A4RCXMGPQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175219712 (2h26m32.606299843s) [noise=true , address=64.49.13.170:4718 , piece_id=ARME5TI4PRSUPRRJZ2RROZRAP6H2KV44INELLD4EU42PKF4KAJFQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175506962 (2h26m32.606587093s) [noise=true , address=64.49.13.169:4708 , piece_id=W5YFSGNCM663W3CHXKZ5JHNQC5HT7BCM4T42746M3JSBWSWUOSIA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175746721 (2h26m32.606826842s) [noise=true , address=79.127.205.235:4663 , piece_id=NSILXCWTRRF3Y2Z76ELXSU5LBDBY355NL37MCQFQI6PFWURYNDOQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.175990407 (2h26m32.607070538s) [noise=true , address=104.36.82.13:4205 , piece_id=4S4HZM5EJHQDE6SI7UTOMOBBQ556MFSIAQXFQEE7KSQOTE664NOA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.176235245 (2h26m32.607315377s) [noise=true , address=104.36.82.34:4546 , piece_id=D5VNYIUFPOACPNRIWXJNOVKUVCXEBHSGOMBQPTXO5TBUUFNPIITQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.176502587 (2h26m32.607582718s) [noise=true , address=79.127.201.214:4307 , piece_id=I7DNFJ6TOCYNUEKQ3BGXTPDEVZEKFNYH4ONHQ7S77N47FKWMJVQQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.176733388 (2h26m32.607813509s) [noise=true , address=104.36.82.47:4552 , piece_id=KN7M4D4Q4HSREC7RDABR4MKN5Y4H6PFEIGG3W6ILUJZWS4FGHULA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.176977596 (2h26m32.608057727s) [noise=true , address=64.49.13.170:4725 , piece_id=JJZ6SSURGVZALEEZGNFL3443XWKBD5MYXKHFD7F5DT3EJDFRVMMQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.177340149 (2h26m32.60842028s) [noise=true , address=104.36.82.37:4684 , piece_id=2L7CSYBHUS2LNMRS5JWTVUTXGZA6WOWV5GIDOK2SNDFXSXJT4ZEA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.178155700 (2h26m32.609235851s) [noise=true , address=104.36.82.62:4432 , piece_id=HUASG5J2NFKB62SAT2KQS7AJ4QROII52PRF75FM4GV5FBQJJBWJQ, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.178505939 (2h26m32.60958607s) [noise=true , address=104.36.82.60:4365 , piece_id=TEGQJHMEBZSBARVJKIORYADUMEAEZTA4POPY4VRNFSD25UNMFOZA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.178775044 (2h26m32.609855176s) [noise=true , address=104.36.82.61:4383 , piece_id=744ODK6G6U6UJFNZUR4S6NL3DHHL2OOGGE3BIGXTUHUZ7TVY5RVA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:38.179015054 (2h26m32.610095185s) [noise=true , address=104.36.82.36:4629 , piece_id=POYO6XNK2NOZRQNMTM23LNFIM54C6UCTMAYPV2CG4Y7UKTRY2CRA, seg_pos={0 0}, upload=2592]: Uploading piece... Aug 8 19:52:39.280548684 (2h26m33.711628815s) [upload=2592]: Next returned nil segment Aug 8 19:52:39.280567661 (2h26m33.711647792s) [upload=2592]: Waiting for error group managing segments... Aug 8 19:52:39.558309056 (2h26m33.989389187s) [noise=true , address=79.127.205.235:4663 , piece_id=NSILXCWTRRF3Y2Z76ELXSU5LBDBY355NL37MCQFQI6PFWURYNDOQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.602003566 (2h26m34.033083697s) [noise=true , address=64.49.13.137:4495 , piece_id=2HRMMNHSBXOLQ5Q2C2ISWWK4LX74VIK5ZKGTOZ3EXF7A4RCXMGPQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.606090526 (2h26m34.037170657s) [noise=true , address=64.49.13.169:4708 , piece_id=W5YFSGNCM663W3CHXKZ5JHNQC5HT7BCM4T42746M3JSBWSWUOSIA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.653486648 (2h26m34.084566789s) [noise=true , address=64.49.13.170:4718 , piece_id=ARME5TI4PRSUPRRJZ2RROZRAP6H2KV44INELLD4EU42PKF4KAJFQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.661305568 (2h26m34.092385699s) [noise=true , address=64.49.13.27:4961 , piece_id=RLEDVUSBWUD45CJSPAAUI55W454Z3R2Z36FVBBKTEZRRCM66TQDA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:39.740934219 (2h26m34.17201435s) [noise=true , address=64.49.13.170:4725 , piece_id=JJZ6SSURGVZALEEZGNFL3443XWKBD5MYXKHFD7F5DT3EJDFRVMMQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.079296590 (2h26m34.510376721s) [noise=true , address=79.127.201.214:4307 , piece_id=I7DNFJ6TOCYNUEKQ3BGXTPDEVZEKFNYH4ONHQ7S77N47FKWMJVQQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.126313677 (2h26m34.557393828s) [noise=true , address=104.36.82.34:4546 , piece_id=D5VNYIUFPOACPNRIWXJNOVKUVCXEBHSGOMBQPTXO5TBUUFNPIITQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.148317597 (2h26m34.579397728s) [noise=true , address=104.36.82.60:4365 , piece_id=TEGQJHMEBZSBARVJKIORYADUMEAEZTA4POPY4VRNFSD25UNMFOZA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.193741135 (2h26m34.624821266s) [noise=true , address=104.36.82.36:4629 , piece_id=POYO6XNK2NOZRQNMTM23LNFIM54C6UCTMAYPV2CG4Y7UKTRY2CRA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.195908390 (2h26m34.626988521s) [noise=true , address=104.36.82.62:4432 , piece_id=HUASG5J2NFKB62SAT2KQS7AJ4QROII52PRF75FM4GV5FBQJJBWJQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.221702853 (2h26m34.652782984s) [noise=true , address=104.36.82.61:4383 , piece_id=744ODK6G6U6UJFNZUR4S6NL3DHHL2OOGGE3BIGXTUHUZ7TVY5RVA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.246878160 (2h26m34.677958291s) [noise=true , address=104.36.82.13:4205 , piece_id=4S4HZM5EJHQDE6SI7UTOMOBBQ556MFSIAQXFQEE7KSQOTE664NOA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.303043180 (2h26m34.734123301s) [noise=true , address=45.91.116.7:4023 , piece_id=HNIYSD6PGHD4HQET5LQNZSGMQDKRVQ436U2E5WHXMQ6VH5HFVW5Q, seg_pos={0 0}, upload=2592]: Done uploading piece. err: <nil> Aug 8 19:52:40.303068047 (2h26m34.734148178s) [seg_pos={0 0}, upload=2592]: Segment reached optimal threshold of 14 pieces. Aug 8 19:52:40.303294891 (2h26m34.734375012s) [noise=true , address=104.36.82.39:4752 , piece_id=UR5CF3AAMVIY23LFOWZGUXJ5OSP2PFMM2FCZPTTRAPNZPC54UNIA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qoB7SaK4p6GwyHAKnheGGuMvQFzA3cerZL5nx7KnpazomyCTT): protocol: expected piece hash; context canceled; EOF Aug 8 19:52:40.303400803 (2h26m34.734480934s) [noise=true , address=104.36.82.37:4684 , piece_id=2L7CSYBHUS2LNMRS5JWTVUTXGZA6WOWV5GIDOK2SNDFXSXJT4ZEA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123rwT3AmQR5nrvjoo6fgKBBJaKVWJHkJ6FtLnoNYs2AxakoDZC): protocol: read tcp 188.166.225.170:51968->104.36.82.37:4684: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 19:52:40.303468473 (2h26m34.734548594s) [noise=true , address=104.36.82.47:4552 , piece_id=KN7M4D4Q4HSREC7RDABR4MKN5Y4H6PFEIGG3W6ILUJZWS4FGHULA, seg_pos={0 0}, upload=2592]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hoXgBFoGKKknrobbqfArxNhrsiUHKiiVZGWCnvxDSgBcae8gw): protocol: rpc: dial tcp 104.36.82.47:4552: operation was canceled; context canceled Aug 8 19:52:40.303493000 (2h26m34.734573131s) [noise=true , address=104.36.82.4:4817 , piece_id=GVXESXWUXLSGLDXHIQCOGLAYCSYLN6RKZ62OTR2CKYKOBCSJ2VRQ, seg_pos={0 0}, upload=2592]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: read tcp 188.166.225.170:36592->104.36.82.4:4817: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 19:52:40.303518960 (2h26m34.734599091s) [seg_pos={0 0}, upload=2592]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 19:52:40.303590456 (2h26m34.734670587s) [upload=2592]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 19:52:40.303595266 (2h26m34.734675397s) [upload=2592]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:52:40.778365243 (2h26m35.209445364s) [upload=2592]: Done uploading segments... Aug 8 19:52:40.778383587 (2h26m35.209463718s) [upload=2592]: Upload finished. err: <nil> Duration: 5.9620932s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X.........................X......X..X........] duration: 5.961580437s FAIL (2025-08-08 19:52:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:46:30.580855164 (2h20m25.011935295s) [upload=2481]: Starting upload Aug 8 19:46:30.580905210 (2h20m25.011985341s) [upload=2481]: Done starting upload Aug 8 19:46:30.581041871 (2h20m25.012122002s) [upload=2481]: Uploading segments... Aug 8 19:46:30.581135511 (2h20m25.012215632s) [upload=2481]: Got next segment. Inline: false Aug 8 19:46:30.581201747 (2h20m25.012281879s) [upload=2481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:46:30.581206276 (2h20m25.012286407s) [upload=2481]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:46:30.795258868 (2h20m25.226338999s) [upload=2481]: Next segment err: metaclient: Too Many Requests Aug 8 19:46:30.795302111 (2h20m25.226382242s) [upload=2481]: Done uploading segments... Aug 8 19:46:30.795317450 (2h20m25.226397581s) [upload=2481]: Upload finished. err: metaclient: Too Many Requests Duration: 5.961608701s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [........................XX...........X..X.....X.............] duration: 1.831422622s FAIL (2025-08-08 19:52:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.831446397s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........................XX...........X..X.....X............] duration: 1.90009673s FAIL (2025-08-08 19:51:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.90012765s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X.........................X......X..X.......] duration: 6.488216761s FAIL (2025-08-08 19:51:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:46:30.580855164 (2h20m25.011935295s) [upload=2481]: Starting upload Aug 8 19:46:30.580905210 (2h20m25.011985341s) [upload=2481]: Done starting upload Aug 8 19:46:30.581041871 (2h20m25.012122002s) [upload=2481]: Uploading segments... Aug 8 19:46:30.581135511 (2h20m25.012215632s) [upload=2481]: Got next segment. Inline: false Aug 8 19:46:30.581201747 (2h20m25.012281879s) [upload=2481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:46:30.581206276 (2h20m25.012286407s) [upload=2481]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:46:30.795258868 (2h20m25.226338999s) [upload=2481]: Next segment err: metaclient: Too Many Requests Aug 8 19:46:30.795302111 (2h20m25.226382242s) [upload=2481]: Done uploading segments... Aug 8 19:46:30.795317450 (2h20m25.226397581s) [upload=2481]: Upload finished. err: metaclient: Too Many Requests Duration: 6.48824291s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..........................XX...........X..X.....X...........] duration: 1.974365289s FAIL (2025-08-08 19:50:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.974385668s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X................X.........................X......X..X......] duration: 6.282445332s FAIL (2025-08-08 19:50:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:46:30.580855164 (2h20m25.011935295s) [upload=2481]: Starting upload Aug 8 19:46:30.580905210 (2h20m25.011985341s) [upload=2481]: Done starting upload Aug 8 19:46:30.581041871 (2h20m25.012122002s) [upload=2481]: Uploading segments... Aug 8 19:46:30.581135511 (2h20m25.012215632s) [upload=2481]: Got next segment. Inline: false Aug 8 19:46:30.581201747 (2h20m25.012281879s) [upload=2481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:46:30.581206276 (2h20m25.012286407s) [upload=2481]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:46:30.795258868 (2h20m25.226338999s) [upload=2481]: Next segment err: metaclient: Too Many Requests Aug 8 19:46:30.795302111 (2h20m25.226382242s) [upload=2481]: Done uploading segments... Aug 8 19:46:30.795317450 (2h20m25.226397581s) [upload=2481]: Upload finished. err: metaclient: Too Many Requests Duration: 6.28246554s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...........................XX...........X..X.....X..........] duration: 1.832684575s FAIL (2025-08-08 19:50:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.832711235s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [............................XX...........X..X.....X.........] duration: 1.91771462s FAIL (2025-08-08 19:50:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.917741692s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X................X.........................X......X..X.....] duration: 6.197192379s FAIL (2025-08-08 19:49:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:46:30.580855164 (2h20m25.011935295s) [upload=2481]: Starting upload Aug 8 19:46:30.580905210 (2h20m25.011985341s) [upload=2481]: Done starting upload Aug 8 19:46:30.581041871 (2h20m25.012122002s) [upload=2481]: Uploading segments... Aug 8 19:46:30.581135511 (2h20m25.012215632s) [upload=2481]: Got next segment. Inline: false Aug 8 19:46:30.581201747 (2h20m25.012281879s) [upload=2481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:46:30.581206276 (2h20m25.012286407s) [upload=2481]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:46:30.795258868 (2h20m25.226338999s) [upload=2481]: Next segment err: metaclient: Too Many Requests Aug 8 19:46:30.795302111 (2h20m25.226382242s) [upload=2481]: Done uploading segments... Aug 8 19:46:30.795317450 (2h20m25.226397581s) [upload=2481]: Upload finished. err: metaclient: Too Many Requests Duration: 6.197215483s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.............................XX...........X..X.....X........] duration: 1.836094116s FAIL (2025-08-08 19:49:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.836114435s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X................X.........................X......X..X....] duration: 6.272763315s FAIL (2025-08-08 19:49:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:46:30.580855164 (2h20m25.011935295s) [upload=2481]: Starting upload Aug 8 19:46:30.580905210 (2h20m25.011985341s) [upload=2481]: Done starting upload Aug 8 19:46:30.581041871 (2h20m25.012122002s) [upload=2481]: Uploading segments... Aug 8 19:46:30.581135511 (2h20m25.012215632s) [upload=2481]: Got next segment. Inline: false Aug 8 19:46:30.581201747 (2h20m25.012281879s) [upload=2481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:46:30.581206276 (2h20m25.012286407s) [upload=2481]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:46:30.795258868 (2h20m25.226338999s) [upload=2481]: Next segment err: metaclient: Too Many Requests Aug 8 19:46:30.795302111 (2h20m25.226382242s) [upload=2481]: Done uploading segments... Aug 8 19:46:30.795317450 (2h20m25.226397581s) [upload=2481]: Upload finished. err: metaclient: Too Many Requests Duration: 6.272786709s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X................X.........................X......X..X...] duration: 6.653901393s FAIL (2025-08-08 19:48:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:46:30.580855164 (2h20m25.011935295s) [upload=2481]: Starting upload Aug 8 19:46:30.580905210 (2h20m25.011985341s) [upload=2481]: Done starting upload Aug 8 19:46:30.581041871 (2h20m25.012122002s) [upload=2481]: Uploading segments... Aug 8 19:46:30.581135511 (2h20m25.012215632s) [upload=2481]: Got next segment. Inline: false Aug 8 19:46:30.581201747 (2h20m25.012281879s) [upload=2481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:46:30.581206276 (2h20m25.012286407s) [upload=2481]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:46:30.795258868 (2h20m25.226338999s) [upload=2481]: Next segment err: metaclient: Too Many Requests Aug 8 19:46:30.795302111 (2h20m25.226382242s) [upload=2481]: Done uploading segments... Aug 8 19:46:30.795317450 (2h20m25.226397581s) [upload=2481]: Upload finished. err: metaclient: Too Many Requests Duration: 6.653924045s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..............................XX...........X..X.....X.......] duration: 1.856170059s FAIL (2025-08-08 19:48:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.856197592s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X................X.........................X......X..X..] duration: 6.611439284s FAIL (2025-08-08 19:47:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:46:30.580855164 (2h20m25.011935295s) [upload=2481]: Starting upload Aug 8 19:46:30.580905210 (2h20m25.011985341s) [upload=2481]: Done starting upload Aug 8 19:46:30.581041871 (2h20m25.012122002s) [upload=2481]: Uploading segments... Aug 8 19:46:30.581135511 (2h20m25.012215632s) [upload=2481]: Got next segment. Inline: false Aug 8 19:46:30.581201747 (2h20m25.012281879s) [upload=2481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:46:30.581206276 (2h20m25.012286407s) [upload=2481]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:46:30.795258868 (2h20m25.226338999s) [upload=2481]: Next segment err: metaclient: Too Many Requests Aug 8 19:46:30.795302111 (2h20m25.226382242s) [upload=2481]: Done uploading segments... Aug 8 19:46:30.795317450 (2h20m25.226397581s) [upload=2481]: Upload finished. err: metaclient: Too Many Requests Duration: 6.611478979s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...............................XX...........X..X.....X......] duration: 1.892180405s FAIL (2025-08-08 19:47:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:44:17.480947153 (2h18m11.912027284s) [upload=2444]: Starting upload Aug 8 19:44:17.480992550 (2h18m11.912072681s) [upload=2444]: Done starting upload Aug 8 19:44:17.481040722 (2h18m11.912120853s) [upload=2444]: Uploading segments... Aug 8 19:44:17.481072643 (2h18m11.912152774s) [upload=2444]: Got next segment. Inline: true Aug 8 19:44:17.481076280 (2h18m11.912156411s) [upload=2444]: Waiting for error group managing segments... Aug 8 19:44:17.481108873 (2h18m11.912189004s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:44:17.481112840 (2h18m11.912192971s) [upload=2444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 19:44:17.481115435 (2h18m11.912195566s) [upload=2444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 19:44:17.693449099 (2h18m12.12452923s) [upload=2444]: Done uploading segments... Aug 8 19:44:17.693468616 (2h18m12.124548747s) [upload=2444]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.892207349s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X................X.........................X......X..X.] duration: 6.093633531s FAIL (2025-08-08 19:46:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 19:46:30.580855164 (2h20m25.011935295s) [upload=2481]: Starting upload Aug 8 19:46:30.580905210 (2h20m25.011985341s) [upload=2481]: Done starting upload Aug 8 19:46:30.581041871 (2h20m25.012122002s) [upload=2481]: Uploading segments... Aug 8 19:46:30.581135511 (2h20m25.012215632s) [upload=2481]: Got next segment. Inline: false Aug 8 19:46:30.581201747 (2h20m25.012281879s) [upload=2481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 19:46:30.581206276 (2h20m25.012286407s) [upload=2481]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 19:46:30.795258868 (2h20m25.226338999s) [upload=2481]: Next segment err: metaclient: Too Many Requests Aug 8 19:46:30.795302111 (2h20m25.226382242s) [upload=2481]: Done uploading segments... Aug 8 19:46:30.795317450 (2h20m25.226397581s) [upload=2481]: Upload finished. err: metaclient: Too Many Requests Duration: 6.093656714s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)