Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X...................X..........................X..........] duration: 6.123514755s FAIL (2025-08-12 18:06:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments... Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment... Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment. Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments... Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces. Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments... Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil> Duration: 6.123555422s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X...................X..........................X.........] duration: 6.130901929s FAIL (2025-08-12 18:06:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments... Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment... Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment. Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments... Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces. Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments... Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil> Duration: 6.130923893s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X...................X.......X.............................X.] duration: 1.850487221s FAIL (2025-08-12 18:05:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.850514614s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X...................X..........................X........] duration: 5.922902375s FAIL (2025-08-12 18:05:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments... Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment... Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment. Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments... Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces. Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments... Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil> Duration: 5.922925769s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X...................X.......X.............................X] duration: 905.581241ms FAIL (2025-08-12 18:05:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests Duration:* 905.603224ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X...................X..........................X.......] duration: 5.979801105s FAIL (2025-08-12 18:04:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments... Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment... Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment. Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments... Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces. Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments... Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil> Duration: 5.979828326s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X...................X.......X.............................] duration: 1.935737936s FAIL (2025-08-12 18:04:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.935760288s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X...................X.......X............................] duration: 1.878733506s FAIL (2025-08-12 18:04:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.878755959s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X...................X..........................X......] duration: 5.755302742s FAIL (2025-08-12 18:03:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments... Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment... Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment. Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments... Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces. Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments... Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil> Duration: 5.755324413s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X...................X.......X...........................] duration: 1.870499194s FAIL (2025-08-12 18:02:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.870530022s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X......X...................X..........................X.....] duration: 6.069723677s FAIL (2025-08-12 18:02:54 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments... Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment... Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment. Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments... Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces. Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments... Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil> Duration: 6.069752112s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X......X...................X..........................X....] duration: 5.944351468s FAIL (2025-08-12 18:02:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments... Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment... Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment. Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments... Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces. Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments... Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil> Duration: 5.944377768s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X...................X.......X..........................] duration: 1.832508113s FAIL (2025-08-12 18:01:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.832566344s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X...................X.......X.........................] duration: 1.843476949s FAIL (2025-08-12 18:01:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.843501196s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X......X...................X..........................X...] duration: 5.903066965s FAIL (2025-08-12 18:01:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments... Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment... Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment. Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments... Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces. Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments... Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil> Duration: 5.903086953s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X...................X.......X........................] duration: 1.862950017s FAIL (2025-08-12 18:00:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.862978402s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X......X...................X..........................X..] duration: 6.197392521s FAIL (2025-08-12 18:00:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments... Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment... Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment. Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments... Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces. Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments... Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil> Duration: 6.197417609s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X...................X.......X.......................] duration: 2.082341828s FAIL (2025-08-12 17:59:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.08236927s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X......X...................X..........................X.] duration: 6.017764949s FAIL (2025-08-12 17:59:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments... Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment... Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment. Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments... Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces. Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments... Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil> Duration: 6.017790858s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X...................X.......X......................] duration: 1.838241973s FAIL (2025-08-12 17:58:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.838275768s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X......X...................X..........................X] duration: 4.24212204s FAIL (2025-08-12 17:58:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments... Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment... Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment. Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece... Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments... Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil> Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces. Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments... Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil> Duration: 4.24214305s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X...................X.......X.....................] duration: 1.861771352s FAIL (2025-08-12 17:58:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.861792743s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X...................X.......X....................] duration: 1.955437207s FAIL (2025-08-12 17:57:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.95547083s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.....X......X...................X..........................] duration: 5.993046064s FAIL (2025-08-12 17:57:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 5.993072454s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.....X......X...................X.........................] duration: 5.677139708s FAIL (2025-08-12 17:56:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 5.677167041s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X...........X...................X.......X...................] duration: 1.833186962s FAIL (2025-08-12 17:56:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.83332215s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.....X......X...................X........................] duration: 5.888841047s FAIL (2025-08-12 17:56:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 5.888866916s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X...........X...................X.......X..................] duration: 1.857430025s FAIL (2025-08-12 17:55:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.857460433s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X...........X...................X.......X.................] duration: 1.891883137s FAIL (2025-08-12 17:55:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.891911431s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.....X......X...................X.......................] duration: 5.744455859s FAIL (2025-08-12 17:55:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 5.744476738s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X...........X...................X.......X................] duration: 1.871943217s FAIL (2025-08-12 17:54:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.871969527s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.....X......X...................X......................] duration: 6.762165995s FAIL (2025-08-12 17:54:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 6.762191756s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X.....X......X...................X.....................] duration: 5.955091445s FAIL (2025-08-12 17:53:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 5.955118158s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X...........X...................X.......X...............] duration: 1.853250682s FAIL (2025-08-12 17:53:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.853276262s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X.....X......X...................X....................] duration: 5.943734984s FAIL (2025-08-12 17:53:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 5.943760825s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....X...........X...................X.......X..............] duration: 1.852055405s FAIL (2025-08-12 17:52:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.852082027s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X.....X......X...................X...................] duration: 5.622812723s FAIL (2025-08-12 17:52:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 5.622832251s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X...........X...................X.......X.............] duration: 1.846417215s FAIL (2025-08-12 17:52:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.846447723s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X...........X...................X.......X............] duration: 1.812550338s FAIL (2025-08-12 17:51:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.812577309s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X.....X......X...................X..................] duration: 6.945863683s FAIL (2025-08-12 17:51:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 6.945911114s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X...........X...................X.......X...........] duration: 2.181041296s FAIL (2025-08-12 17:50:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.181063898s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X.....X......X...................X.................] duration: 5.823297625s FAIL (2025-08-12 17:50:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 5.823323865s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........X...........X...................X.......X..........] duration: 1.842607961s FAIL (2025-08-12 17:50:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.842638027s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X...........X...................X.......X.........] duration: 2.057737773s FAIL (2025-08-12 17:49:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.057761578s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X.....X......X...................X................] duration: 6.174547932s FAIL (2025-08-12 17:49:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 6.174563402s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........X...........X...................X.......X........] duration: 1.867746099s FAIL (2025-08-12 17:48:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.867776627s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X..........X.....X......X...................X...............] duration: 5.953402281s FAIL (2025-08-12 17:48:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 5.953426789s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............X...........X...................X.......X.......] duration: 1.957047157s FAIL (2025-08-12 17:48:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.957071853s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X..........X.....X......X...................X..............] duration: 5.740423401s FAIL (2025-08-12 17:47:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 17:37:28.847831210 (96h11m23.278911341s) [upload=100200]: Starting upload Aug 12 17:37:28.847877197 (96h11m23.278957329s) [upload=100200]: Done starting upload Aug 12 17:37:28.847989953 (96h11m23.279070094s) [upload=100200]: Uploading segments... Aug 12 17:37:28.848105314 (96h11m23.279185445s) [upload=100200]: Got next segment. Inline: false Aug 12 17:37:28.848182091 (96h11m23.279262222s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:37:28.848187902 (96h11m23.279268033s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 17:37:29.305498962 (96h11m23.736579093s) [seg_pos={0 0}, upload=100200]: Begin upload segment... Aug 12 17:37:29.305546864 (96h11m23.736627035s) [seg_pos={0 0}, upload=100200]: Done begin upload segment. Aug 12 17:37:29.305569777 (96h11m23.736649908s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305575889 (96h11m23.736656021s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305616336 (96h11m23.736696467s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.305989371 (96h11m23.737069502s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306058512 (96h11m23.737138643s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.306648792 (96h11m23.737728923s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.307170841 (96h11m23.738250972s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308130297 (96h11m23.739210418s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308418267 (96h11m23.739498398s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.308849823 (96h11m23.739929954s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309086006 (96h11m23.740166137s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309324331 (96h11m23.740404462s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.309893300 (96h11m23.740973431s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310123391 (96h11m23.741203522s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310539477 (96h11m23.741619608s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.310774426 (96h11m23.741854547s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.311005388 (96h11m23.742085519s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:29.313751903 (96h11m23.744832034s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Uploading piece... Aug 12 17:37:30.443199618 (96h11m24.874279749s) [upload=100200]: Next returned nil segment Aug 12 17:37:30.443222472 (96h11m24.874302613s) [upload=100200]: Waiting for error group managing segments... Aug 12 17:37:30.732818737 (96h11m25.163898868s) [noise=true , address=64.49.13.169:4706 , piece_id=PYGYTTNA3B4IBIMP37T36EBFQN6DGECPCF5643OYSTNBUF4HO52Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.271188110 (96h11m25.702268232s) [noise=true , address=104.36.82.44:4877 , piece_id=CIPT2UVA73VGTQYGOGCWDZCC6BJPA2HKBM7BUUA5Y6KYY22IBRLQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.291816659 (96h11m25.7228968s) [noise=true , address=104.36.82.5:4860 , piece_id=QAJIOV427MZTPS3EE4KXBYZLGKKPGIAVSIQ6BRF4JG47TFN76MTA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.297549237 (96h11m25.728629369s) [noise=true , address=104.36.82.58:4279 , piece_id=2XEDW72RIL26PHF7TWH3P53B6XOSMDAZK55WW3VMHIXD2P2I6YRA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.337735437 (96h11m25.768815558s) [noise=true , address=77.90.31.21:4880 , piece_id=GHDNAPYH4GUIDK6HP4YHL4ORH2WNVHEOQNYX5R4TOMWJJY72HU4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.343255269 (96h11m25.7743354s) [noise=true , address=77.90.31.18:4838 , piece_id=GSGMAJSH6ES523AG556CRME3UWCUVQVG76VW44U222HZF7Q75K3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.354039533 (96h11m25.785119664s) [noise=true , address=104.36.82.21:4490 , piece_id=Q7JW7TJO47IYJ66PZ2LLPI326TGPP26F5YI2QNVC5B556L6CPZJA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.364526277 (96h11m25.795606398s) [noise=true , address=104.36.82.36:4622 , piece_id=3CU2ZILPHV5G6NRBOLQZ7E3IKCDBFQPQE3OJPMDEDACPIKLZZ6HA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.367166910 (96h11m25.798247051s) [noise=true , address=104.36.82.62:4442 , piece_id=JC3RA6HMNSEZRQMDI6AEHITDFWJAMV7N2P2Y6JRRFDSBJXCR4B3A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.405997295 (96h11m25.837077426s) [noise=true , address=104.36.82.34:4563 , piece_id=OUIQGAIPNTOKY5RTGIBV2LIMU5RVVUCXONWKABVQRAPQLSIHKVBA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.428725112 (96h11m25.859805233s) [noise=true , address=77.90.31.14:4665 , piece_id=XE56SRK6PYB6EZF2TEDY5VOH54O7SNDSN7ZLKOCVLRV5NU4TGOGA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.468151427 (96h11m25.899231548s) [noise=true , address=104.36.82.17:4344 , piece_id=IV63DGWMMIOVSN3VRGHXDRBUZR6BFYIAEESYGL63ZJDLFTJLAE4A, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.474993668 (96h11m25.9060738s) [noise=true , address=104.36.82.37:4666 , piece_id=RQCAC7P2P36PJG4NDVMO2ANNURL3CWQC2HEAVFPMYALGOLGPSSJQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483904919 (96h11m25.91498505s) [noise=true , address=45.91.116.14:4200 , piece_id=LJKDCVLXOSXXBUITDD6RM5IFMUAFDJNV7HACAUH7LOPHVCW6T6XQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: <nil> Aug 12 17:37:31.483940267 (96h11m25.915020388s) [seg_pos={0 0}, upload=100200]: Segment reached optimal threshold of 14 pieces. Aug 12 17:37:31.484099512 (96h11m25.915179643s) [noise=true , address=104.36.82.34:4574 , piece_id=ETHHQPNB2OEZHRFVMKZA3VZIEKJO2HK2NFGKJOADWIHCHQCTGC3Q, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZnB3zQPaoZ54HYpp4XayHrxiZSsC76wj6wk426PPu6tWFspMV): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484197799 (96h11m25.91527794s) [noise=true , address=104.36.82.60:4367 , piece_id=MZEDJZ4ONKO4XKW4MDBL4BL36U2J6EIYJJPI46TKNXBYWFMATZDA, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484264668 (96h11m25.915344799s) [noise=true , address=45.91.116.11:4126 , piece_id=V4BARPMFRTCKXEQ7VB3OZJ7MIGC5JSUW7EKETDQPPQXYH5XJPNIQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF Aug 12 17:37:31.484291679 (96h11m25.9153718s) [noise=true , address=104.36.82.23:4461 , piece_id=77763FUKQIDOW4FOLUTHAJMZLHRE4ZTCORLCPETDSQPNKGL65WHQ, seg_pos={0 0}, upload=100200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA): protocol: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57788->104.36.82.23:4461: use of closed network connection Aug 12 17:37:31.484342115 (96h11m25.915422246s) [seg_pos={0 0}, upload=100200]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 17:37:31.484422088 (96h11m25.915502209s) [upload=100200]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 17:37:31.484426236 (96h11m25.915506357s) [upload=100200]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:37:32.101946611 (96h11m26.533026732s) [upload=100200]: Done uploading segments... Aug 12 17:37:32.101966008 (96h11m26.53304614s) [upload=100200]: Upload finished. err: <nil> Duration: 5.740451906s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............X...........X...................X.......X......] duration: 1.857186122s FAIL (2025-08-12 17:47:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.857212524s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)