Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X..........................X........................] duration:
5.983060367s
FAIL (2025-08-12 18:14:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.983083041s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.......X.............................X..............] duration:
2.028175005s
FAIL (2025-08-12 18:14:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.028216795s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X..........................X.......................] duration:
6.151282048s
FAIL (2025-08-12 18:14:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 6.151312405s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X..........................X......................] duration:
6.306805945s
FAIL (2025-08-12 18:13:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 6.306833327s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.......X.............................X.............] duration:
2.040591602s
FAIL (2025-08-12 18:13:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.040620127s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X..........................X.....................] duration:
5.913699402s
FAIL (2025-08-12 18:13:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.913716535s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.......X.............................X............] duration:
1.903754613s
FAIL (2025-08-12 18:12:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.903777037s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X..........................X....................] duration:
5.85000841s
FAIL (2025-08-12 18:12:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.850036585s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X..........................X...................] duration:
5.872842272s
FAIL (2025-08-12 18:12:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.872868912s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.......X.............................X...........] duration:
1.859256392s
FAIL (2025-08-12 18:12:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.859279828s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.......X.............................X..........] duration:
1.868580459s
FAIL (2025-08-12 18:11:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.868649182s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.......X.............................X.........] duration:
2.145903953s
FAIL (2025-08-12 18:11:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.145928229s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X..........................X..................] duration:
5.832681973s
FAIL (2025-08-12 18:11:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.832712592s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.......X.............................X........] duration:
2.01032229s
FAIL (2025-08-12 18:10:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.010350374s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X..........................X.................] duration:
6.122203446s
FAIL (2025-08-12 18:10:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 6.122228294s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.......X.............................X.......] duration:
1.939827288s
FAIL (2025-08-12 18:10:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.939844521s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X..........................X................] duration:
5.948559707s
FAIL (2025-08-12 18:09:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.948576178s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.......X.............................X......] duration:
1.90340425s
FAIL (2025-08-12 18:09:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.903427234s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.......X.............................X.....] duration:
1.83977728s
FAIL (2025-08-12 18:08:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.839806316s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X..........................X...............] duration:
5.824275654s
FAIL (2025-08-12 18:08:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.824300993s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.......X.............................X....] duration:
1.930238263s
FAIL (2025-08-12 18:08:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.93025843s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X..........................X..............] duration:
6.317021675s
FAIL (2025-08-12 18:08:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 6.317084185s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X..........................X.............] duration:
5.933318989s
FAIL (2025-08-12 18:07:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.933342684s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.......X.............................X...] duration:
2.022764507s
FAIL (2025-08-12 18:07:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.022791107s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X...................X..........................X............] duration:
6.392803355s
FAIL (2025-08-12 18:07:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 6.392825599s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X...................X..........................X...........] duration:
6.033832613s
FAIL (2025-08-12 18:06:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 6.033859063s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.......X.............................X..] duration:
2.182307687s
FAIL (2025-08-12 18:06:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.182369465s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X...................X..........................X..........] duration:
6.123514755s
FAIL (2025-08-12 18:06:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 6.123555422s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X...................X..........................X.........] duration:
6.130901929s
FAIL (2025-08-12 18:06:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 6.130923893s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X...................X.......X.............................X.] duration:
1.850487221s
FAIL (2025-08-12 18:05:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.850514614s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X...................X..........................X........] duration:
5.922902375s
FAIL (2025-08-12 18:05:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.922925769s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X...................X.......X.............................X] duration:
905.581241ms
FAIL (2025-08-12 18:05:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 18:05:16.861277228 (96h39m11.29235735s) [upload=100682]: Starting upload Aug 12 18:05:16.861328837 (96h39m11.292408968s) [upload=100682]: Done starting upload Aug 12 18:05:16.861380887 (96h39m11.292461008s) [upload=100682]: Uploading segments... Aug 12 18:05:16.861428649 (96h39m11.29250878s) [upload=100682]: Got next segment. Inline: true Aug 12 18:05:16.861432566 (96h39m11.292512697s) [upload=100682]: Waiting for error group managing segments... Aug 12 18:05:16.861466210 (96h39m11.292546331s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 18:05:16.861470608 (96h39m11.29255074s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 18:05:16.861473474 (96h39m11.292553605s) [upload=100682]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 18:05:17.075338029 (96h39m11.50641816s) [upload=100682]: Done uploading segments... Aug 12 18:05:17.075357627 (96h39m11.506437758s) [upload=100682]: Upload finished. err: metaclient: Too Many Requests
Duration: 905.603224ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X...................X..........................X.......] duration:
5.979801105s
FAIL (2025-08-12 18:04:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.979828326s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X...................X.......X.............................] duration:
1.935737936s
FAIL (2025-08-12 18:04:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.935760288s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X...................X.......X............................] duration:
1.878733506s
FAIL (2025-08-12 18:04:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.878755959s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X...................X..........................X......] duration:
5.755302742s
FAIL (2025-08-12 18:03:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.755324413s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X...................X.......X...........................] duration:
1.870499194s
FAIL (2025-08-12 18:02:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.870530022s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X......X...................X..........................X.....] duration:
6.069723677s
FAIL (2025-08-12 18:02:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 6.069752112s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X......X...................X..........................X....] duration:
5.944351468s
FAIL (2025-08-12 18:02:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.944377768s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X...................X.......X..........................] duration:
1.832508113s
FAIL (2025-08-12 18:01:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.832566344s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X...................X.......X.........................] duration:
1.843476949s
FAIL (2025-08-12 18:01:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.843501196s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X......X...................X..........................X...] duration:
5.903066965s
FAIL (2025-08-12 18:01:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 5.903086953s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X...................X.......X........................] duration:
1.862950017s
FAIL (2025-08-12 18:00:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.862978402s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X......X...................X..........................X..] duration:
6.197392521s
FAIL (2025-08-12 18:00:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 6.197417609s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X...................X.......X.......................] duration:
2.082341828s
FAIL (2025-08-12 17:59:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.08236927s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X......X...................X..........................X.] duration:
6.017764949s
FAIL (2025-08-12 17:59:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 6.017790858s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X...................X.......X......................] duration:
1.838241973s
FAIL (2025-08-12 17:58:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.838275768s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X......X...................X..........................X] duration:
4.24212204s
FAIL (2025-08-12 17:58:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 17:58:13.808010550 (96h32m8.239090681s) [upload=100565]: Starting upload
Aug 12 17:58:13.808092607 (96h32m8.239172738s) [upload=100565]: Done starting upload
Aug 12 17:58:13.808172140 (96h32m8.239252261s) [upload=100565]: Uploading segments...
Aug 12 17:58:13.808321105 (96h32m8.239401236s) [upload=100565]: Got next segment. Inline: false
Aug 12 17:58:13.808354419 (96h32m8.23943455s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 17:58:13.808358787 (96h32m8.239438918s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 17:58:14.250438413 (96h32m8.681518564s) [seg_pos={0 0}, upload=100565]: Begin upload segment...
Aug 12 17:58:14.250509860 (96h32m8.681589991s) [seg_pos={0 0}, upload=100565]: Done begin upload segment.
Aug 12 17:58:14.250538805 (96h32m8.681808609s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.250810766 (96h32m8.681890897s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.251298709 (96h32m8.68237884s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252811994 (96h32m8.683892125s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.252944307 (96h32m8.684024438s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253429756 (96h32m8.684509888s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.253847806 (96h32m8.684927937s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254200321 (96h32m8.685280452s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254531655 (96h32m8.685611786s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.254860434 (96h32m8.685940565s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255342696 (96h32m8.686422827s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.255743714 (96h32m8.686823845s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.256443442 (96h32m8.687523573s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.257792553 (96h32m8.688872684s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.259457679 (96h32m8.690537811s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.260630524 (96h32m8.691710655s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.261783480 (96h32m8.692863611s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:14.262978376 (96h32m8.694058507s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Uploading piece...
Aug 12 17:58:15.789421903 (96h32m10.220502034s) [upload=100565]: Next returned nil segment
Aug 12 17:58:15.789442643 (96h32m10.220522794s) [upload=100565]: Waiting for error group managing segments...
Aug 12 17:58:16.216168202 (96h32m10.647248333s) [noise=true , address=104.36.82.43:4862 , piece_id=2B6J5HXB43UH2J3A2DQP7IS3CTD7C675XU2FS6L26JRVBXRONZHQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.235639186 (96h32m10.666719307s) [noise=true , address=77.90.31.14:4678 , piece_id=AODUV4ZDVP3GYO2HIICENSK4L3NBBLWHBINFTF3MVYYUHAGTUI5A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.236380254 (96h32m10.667460385s) [noise=true , address=77.90.31.16:4743 , piece_id=JSCWLRQQK7DXOLYCXGKNSB3Y3F7BGIEABYNO5W4ZXEXYH7EV7CKQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.245672373 (96h32m10.676752504s) [noise=true , address=104.36.82.20:4464 , piece_id=7SJ4AGX7G53YAYAJVRJG7GDGLFTRVFPHEZHRLQJE2ST52YLJNNLQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.249456704 (96h32m10.680536825s) [noise=true , address=104.36.82.36:4623 , piece_id=3V7ZX3L43UHNCP7NU2C6PKMSYIUF5SNWWQCFPHTGZIVLOWK4BECA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.271453131 (96h32m10.702533262s) [noise=true , address=104.36.82.19:4408 , piece_id=W5V7PU2A6NCGUH5V3RVEJVFNINIUARCCH3L42M76WEAP3JLZUOIQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.300333979 (96h32m10.73141411s) [noise=true , address=104.36.82.35:4581 , piece_id=37XCDIFSLOAZNFCPTORQS5FO6AOIUVRFS5LWLK6GF3O6MSKT23ZQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.320580497 (96h32m10.751660628s) [noise=true , address=77.90.31.17:4787 , piece_id=VPMIJC6TGTF4SQTRU2TVBCEETFWIS6DSIV7ESQD6FNAWO2LGKMJQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.324205072 (96h32m10.755285203s) [noise=true , address=77.90.31.15:4730 , piece_id=RCHXQQF3QZ6PYEO6K3HYK76HLONKYODKUT2VEJ52NVTF63S6BBEQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.361485152 (96h32m10.792565283s) [noise=true , address=104.36.82.16:4326 , piece_id=SBU2E4PBMMUZRHHMQHWBKTCJKK4FTMWPOSRJLTQEY6XHUMBW57PA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.373841794 (96h32m10.804921925s) [noise=true , address=104.36.82.60:4362 , piece_id=LFSD26OFRDGKPQRVWQO5OGNUKC3Q7TG53J4SBMRXNERJU5QRZA6A, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.386813152 (96h32m10.817893293s) [noise=true , address=104.36.82.44:4890 , piece_id=6QYFPYTT7DWV7IA73M7IZTBJGXG2HGBKLXMEBAGMBGAYPS6KYNGQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.426711312 (96h32m10.857791443s) [noise=true , address=104.36.82.39:4736 , piece_id=V47IOKIXQBIN66HG7TJW7JNA7WHHRSWPBKIUQRH7JJBG2HTUR7RA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440228605 (96h32m10.871308736s) [noise=true , address=104.36.82.23:4461 , piece_id=MEKXR4J66QJUCZTGUBCTKKD3PPCDQHT3NXXTCOUL52PGWFTQV3HQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: <nil>
Aug 12 17:58:16.440253222 (96h32m10.871333353s) [seg_pos={0 0}, upload=100565]: Segment reached optimal threshold of 14 pieces.
Aug 12 17:58:16.440378832 (96h32m10.871458963s) [noise=true , address=104.36.82.58:4265 , piece_id=N7YOSZLZHXWSHQLK2JZYLPQDDLLANKWKOIUJ72LSYFRSGY3WPNNA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvnJetuaEkstkPVNChKo8YQEYC68qRXPGQxx2AKZoHftkhajQ): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440468634 (96h32m10.871548765s) [noise=true , address=77.90.31.18:4836 , piece_id=JEGMR3UMEGFT4MWW7PKLGTSXEXOCZUUNGIDSLLJYQSVF2UJIDCVQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440541994 (96h32m10.871622125s) [noise=true , address=104.36.82.4:4817 , piece_id=VSUYE5H4Y77NCG7PGFJXQNFIOSKGKRHDRPP4ATFTRYJT4HAC4KMA, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RSBodzJxMye65QgkyrzkWCKQ49cnfdu4haUZKW23nWpqzMcYz): protocol: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49158->104.36.82.4:4817: use of closed network connection
Aug 12 17:58:16.440584596 (96h32m10.871664717s) [noise=true , address=104.36.82.47:4519 , piece_id=7WY6WPIOMLKMFQNGY24FZQNIPKNZZ47ZNTSVFHGR5NWBTZ4KZ7CQ, seg_pos={0 0}, upload=100565]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12enbzhEQp1y2H8Fwdb5UqxcMDdgd5HYb5jYfo2U6Fnycvscaw3): protocol: expected piece hash; context canceled; EOF
Aug 12 17:58:16.440606378 (96h32m10.871686509s) [seg_pos={0 0}, upload=100565]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 17:58:16.440677954 (96h32m10.871758075s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 17:58:16.440681921 (96h32m10.871762052s) [upload=100565]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 17:58:16.741089543 (96h32m11.172169674s) [upload=100565]: Done uploading segments...
Aug 12 17:58:16.741107958 (96h32m11.172188089s) [upload=100565]: Upload finished. err: <nil>
Duration: 4.24214305s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X...................X.......X.....................] duration:
1.861771352s
FAIL (2025-08-12 17:58:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.861792743s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X...................X.......X....................] duration:
1.955437207s
FAIL (2025-08-12 17:57:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 17:43:24.992949222 (96h17m19.424029353s) [upload=100303]: Starting upload Aug 12 17:43:24.992999429 (96h17m19.42407956s) [upload=100303]: Done starting upload Aug 12 17:43:24.993042090 (96h17m19.424122211s) [upload=100303]: Uploading segments... Aug 12 17:43:24.993091074 (96h17m19.424171195s) [upload=100303]: Got next segment. Inline: true Aug 12 17:43:24.993094780 (96h17m19.424174912s) [upload=100303]: Waiting for error group managing segments... Aug 12 17:43:24.993126541 (96h17m19.424206672s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 17:43:24.993130669 (96h17m19.4242108s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 17:43:24.993133344 (96h17m19.424213475s) [upload=100303]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 17:43:25.205714795 (96h17m19.636794936s) [upload=100303]: Done uploading segments... Aug 12 17:43:25.205732278 (96h17m19.636812409s) [upload=100303]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.95547083s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|