Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X...........................X.X.........X...........] duration:
6.680333288s
FAIL (2025-08-09 19:47:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.680359267s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.................X.X...................] duration:
1.863476118s
FAIL (2025-08-09 19:47:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.863510645s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X...........................X.X.........X..........] duration:
7.86116412s
FAIL (2025-08-09 19:46:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 7.861180422s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.................X.X..................] duration:
1.891814569s
FAIL (2025-08-09 19:46:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.891838555s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X...........................X.X.........X.........] duration:
6.448991188s
FAIL (2025-08-09 19:46:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.44901809s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.................X.X.................] duration:
1.935835385s
FAIL (2025-08-09 19:45:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.935856725s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.................X.X................] duration:
1.836543887s
FAIL (2025-08-09 19:44:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.843501501s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........X...........................X.X.........X........] duration:
6.620862243s
FAIL (2025-08-09 19:44:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.620892192s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............X...........................X.X.........X.......] duration:
6.470205728s
FAIL (2025-08-09 19:44:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.470230667s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X.................X.X...............] duration:
1.887860273s
FAIL (2025-08-09 19:43:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.887885952s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............X...........................X.X.........X......] duration:
10.034370731s
FAIL (2025-08-09 19:43:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 10.034390711s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.................X.X..............] duration:
1.953449818s
FAIL (2025-08-09 19:42:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.953472871s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............X...........................X.X.........X.....] duration:
6.089124938s
FAIL (2025-08-09 19:42:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.08921923s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................X.................X.X.............] duration:
1.876533591s
FAIL (2025-08-09 19:42:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.876559029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............X...........................X.X.........X....] duration:
6.908835777s
FAIL (2025-08-09 19:41:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.908853461s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................X...........................X.X.........X...] duration:
7.407276193s
FAIL (2025-08-09 19:41:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 7.407304176s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................X.................X.X............] duration:
2.064829527s
FAIL (2025-08-09 19:41:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.064858561s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X...........................X.X.........X..] duration:
6.831949572s
FAIL (2025-08-09 19:40:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.831972998s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................X...........................X.X.........X.] duration:
6.450665644s
FAIL (2025-08-09 19:40:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.450708616s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............................X.................X.X...........] duration:
1.812005369s
FAIL (2025-08-09 19:39:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.812029708s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............................X.................X.X..........] duration:
1.824223283s
FAIL (2025-08-09 19:39:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.824265495s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X..................X...........................X.X.........X] duration:
7.316606739s
FAIL (2025-08-09 19:39:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 7.316631476s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............................X.................X.X.........] duration:
2.094976384s
FAIL (2025-08-09 19:39:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.09500504s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..................X...........................X.X.........] duration:
8.787697733s
FAIL (2025-08-09 19:38:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 19:31:39.969320940 (26h5m34.400401071s) [upload=27242]: Starting upload
Aug 9 19:31:39.969359324 (26h5m34.400439455s) [upload=27242]: Done starting upload
Aug 9 19:31:39.969456630 (26h5m34.400536761s) [upload=27242]: Uploading segments...
Aug 9 19:31:39.969557924 (26h5m34.400638055s) [upload=27242]: Got next segment. Inline: false
Aug 9 19:31:39.969586949 (26h5m34.40066708s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:31:39.969592861 (26h5m34.400673032s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:31:40.423036151 (26h5m34.854116282s) [seg_pos={0 0}, upload=27242]: Begin upload segment...
Aug 9 19:31:40.423082850 (26h5m34.854162981s) [seg_pos={0 0}, upload=27242]: Done begin upload segment.
Aug 9 19:31:40.423105053 (26h5m34.854185184s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423142424 (26h5m34.854222555s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423497523 (26h5m34.854577644s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423591874 (26h5m34.854672006s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423787018 (26h5m34.854867149s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423893642 (26h5m34.854973773s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424084347 (26h5m34.855164478s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424220457 (26h5m34.855300588s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424378258 (26h5m34.85545838s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424632546 (26h5m34.855712667s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424933993 (26h5m34.856014124s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425167709 (26h5m34.85624783s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425378573 (26h5m34.856458704s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425591419 (26h5m34.856671551s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425793367 (26h5m34.856873498s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426032654 (26h5m34.857112785s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426231294 (26h5m34.857311426s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426419895 (26h5m34.857500027s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:41.541363019 (26h5m35.97244315s) [upload=27242]: Next returned nil segment
Aug 9 19:31:41.541379470 (26h5m35.972459601s) [upload=27242]: Waiting for error group managing segments...
Aug 9 19:31:41.825362699 (26h5m36.25644283s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:41.853215159 (26h5m36.28429529s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.366836308 (26h5m36.797916439s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.442770694 (26h5m36.873850825s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.493054342 (26h5m36.924134503s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.496276868 (26h5m36.927356989s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.505091103 (26h5m36.936171234s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.561854769 (26h5m36.99293489s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.593180115 (26h5m37.024260246s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.622110047 (26h5m37.053190188s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.903832219 (26h5m37.33491235s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.088179587 (26h5m38.519259708s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.496775159 (26h5m38.92785529s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726859432 (26h5m39.157939563s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726903787 (26h5m39.157983918s) [seg_pos={0 0}, upload=27242]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:31:44.727357876 (26h5m39.158438007s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection
Aug 9 19:31:44.727407300 (26h5m39.158487431s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L5Mr53vCqKr4gy7N4rAaVCC9FvU8XdYKFrxWrJL728dt3LmR): protocol: rpc: dial tcp 104.36.82.43:4833: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727424704 (26h5m39.158504825s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SUeS7dkCCLwuiEW1U8X4vkbeejj7votE3hhKdgbBo1mUEa3Dd): protocol: write tcp 188.166.225.170:39062->104.36.82.62:4419: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727471663 (26h5m39.158551794s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: read tcp 188.166.225.170:33228->104.36.82.16:4300: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727490039 (26h5m39.15857017s) [seg_pos={0 0}, upload=27242]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:31:44.727563269 (26h5m39.1586434s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:31:44.727567407 (26h5m39.158647538s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:31:45.026735529 (26h5m39.45781565s) [upload=27242]: Done uploading segments...
Aug 9 19:31:45.026753212 (26h5m39.457833343s) [upload=27242]: Upload finished. err: <nil>
Duration: 8.787744222s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X..............................X.................X.X........] duration:
2.048505858s
FAIL (2025-08-09 19:38:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.048528061s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X..............................X.................X.X.......] duration:
1.846679972s
FAIL (2025-08-09 19:38:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.846707415s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..................X...........................X.X........] duration:
6.790228714s
FAIL (2025-08-09 19:38:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 19:31:39.969320940 (26h5m34.400401071s) [upload=27242]: Starting upload
Aug 9 19:31:39.969359324 (26h5m34.400439455s) [upload=27242]: Done starting upload
Aug 9 19:31:39.969456630 (26h5m34.400536761s) [upload=27242]: Uploading segments...
Aug 9 19:31:39.969557924 (26h5m34.400638055s) [upload=27242]: Got next segment. Inline: false
Aug 9 19:31:39.969586949 (26h5m34.40066708s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:31:39.969592861 (26h5m34.400673032s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:31:40.423036151 (26h5m34.854116282s) [seg_pos={0 0}, upload=27242]: Begin upload segment...
Aug 9 19:31:40.423082850 (26h5m34.854162981s) [seg_pos={0 0}, upload=27242]: Done begin upload segment.
Aug 9 19:31:40.423105053 (26h5m34.854185184s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423142424 (26h5m34.854222555s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423497523 (26h5m34.854577644s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423591874 (26h5m34.854672006s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423787018 (26h5m34.854867149s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423893642 (26h5m34.854973773s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424084347 (26h5m34.855164478s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424220457 (26h5m34.855300588s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424378258 (26h5m34.85545838s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424632546 (26h5m34.855712667s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424933993 (26h5m34.856014124s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425167709 (26h5m34.85624783s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425378573 (26h5m34.856458704s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425591419 (26h5m34.856671551s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425793367 (26h5m34.856873498s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426032654 (26h5m34.857112785s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426231294 (26h5m34.857311426s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426419895 (26h5m34.857500027s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:41.541363019 (26h5m35.97244315s) [upload=27242]: Next returned nil segment
Aug 9 19:31:41.541379470 (26h5m35.972459601s) [upload=27242]: Waiting for error group managing segments...
Aug 9 19:31:41.825362699 (26h5m36.25644283s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:41.853215159 (26h5m36.28429529s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.366836308 (26h5m36.797916439s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.442770694 (26h5m36.873850825s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.493054342 (26h5m36.924134503s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.496276868 (26h5m36.927356989s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.505091103 (26h5m36.936171234s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.561854769 (26h5m36.99293489s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.593180115 (26h5m37.024260246s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.622110047 (26h5m37.053190188s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.903832219 (26h5m37.33491235s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.088179587 (26h5m38.519259708s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.496775159 (26h5m38.92785529s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726859432 (26h5m39.157939563s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726903787 (26h5m39.157983918s) [seg_pos={0 0}, upload=27242]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:31:44.727357876 (26h5m39.158438007s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection
Aug 9 19:31:44.727407300 (26h5m39.158487431s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L5Mr53vCqKr4gy7N4rAaVCC9FvU8XdYKFrxWrJL728dt3LmR): protocol: rpc: dial tcp 104.36.82.43:4833: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727424704 (26h5m39.158504825s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SUeS7dkCCLwuiEW1U8X4vkbeejj7votE3hhKdgbBo1mUEa3Dd): protocol: write tcp 188.166.225.170:39062->104.36.82.62:4419: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727471663 (26h5m39.158551794s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: read tcp 188.166.225.170:33228->104.36.82.16:4300: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727490039 (26h5m39.15857017s) [seg_pos={0 0}, upload=27242]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:31:44.727563269 (26h5m39.1586434s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:31:44.727567407 (26h5m39.158647538s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:31:45.026735529 (26h5m39.45781565s) [upload=27242]: Done uploading segments...
Aug 9 19:31:45.026753212 (26h5m39.457833343s) [upload=27242]: Upload finished. err: <nil>
Duration: 6.790257179s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X..............................X.................X.X......] duration:
1.834156198s
FAIL (2025-08-09 19:37:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.83418286s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X..................X...........................X.X.......] duration:
6.544574692s
FAIL (2025-08-09 19:37:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 19:31:39.969320940 (26h5m34.400401071s) [upload=27242]: Starting upload
Aug 9 19:31:39.969359324 (26h5m34.400439455s) [upload=27242]: Done starting upload
Aug 9 19:31:39.969456630 (26h5m34.400536761s) [upload=27242]: Uploading segments...
Aug 9 19:31:39.969557924 (26h5m34.400638055s) [upload=27242]: Got next segment. Inline: false
Aug 9 19:31:39.969586949 (26h5m34.40066708s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:31:39.969592861 (26h5m34.400673032s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:31:40.423036151 (26h5m34.854116282s) [seg_pos={0 0}, upload=27242]: Begin upload segment...
Aug 9 19:31:40.423082850 (26h5m34.854162981s) [seg_pos={0 0}, upload=27242]: Done begin upload segment.
Aug 9 19:31:40.423105053 (26h5m34.854185184s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423142424 (26h5m34.854222555s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423497523 (26h5m34.854577644s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423591874 (26h5m34.854672006s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423787018 (26h5m34.854867149s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423893642 (26h5m34.854973773s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424084347 (26h5m34.855164478s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424220457 (26h5m34.855300588s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424378258 (26h5m34.85545838s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424632546 (26h5m34.855712667s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424933993 (26h5m34.856014124s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425167709 (26h5m34.85624783s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425378573 (26h5m34.856458704s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425591419 (26h5m34.856671551s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425793367 (26h5m34.856873498s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426032654 (26h5m34.857112785s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426231294 (26h5m34.857311426s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426419895 (26h5m34.857500027s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:41.541363019 (26h5m35.97244315s) [upload=27242]: Next returned nil segment
Aug 9 19:31:41.541379470 (26h5m35.972459601s) [upload=27242]: Waiting for error group managing segments...
Aug 9 19:31:41.825362699 (26h5m36.25644283s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:41.853215159 (26h5m36.28429529s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.366836308 (26h5m36.797916439s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.442770694 (26h5m36.873850825s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.493054342 (26h5m36.924134503s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.496276868 (26h5m36.927356989s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.505091103 (26h5m36.936171234s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.561854769 (26h5m36.99293489s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.593180115 (26h5m37.024260246s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.622110047 (26h5m37.053190188s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.903832219 (26h5m37.33491235s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.088179587 (26h5m38.519259708s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.496775159 (26h5m38.92785529s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726859432 (26h5m39.157939563s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726903787 (26h5m39.157983918s) [seg_pos={0 0}, upload=27242]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:31:44.727357876 (26h5m39.158438007s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection
Aug 9 19:31:44.727407300 (26h5m39.158487431s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L5Mr53vCqKr4gy7N4rAaVCC9FvU8XdYKFrxWrJL728dt3LmR): protocol: rpc: dial tcp 104.36.82.43:4833: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727424704 (26h5m39.158504825s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SUeS7dkCCLwuiEW1U8X4vkbeejj7votE3hhKdgbBo1mUEa3Dd): protocol: write tcp 188.166.225.170:39062->104.36.82.62:4419: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727471663 (26h5m39.158551794s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: read tcp 188.166.225.170:33228->104.36.82.16:4300: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727490039 (26h5m39.15857017s) [seg_pos={0 0}, upload=27242]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:31:44.727563269 (26h5m39.1586434s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:31:44.727567407 (26h5m39.158647538s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:31:45.026735529 (26h5m39.45781565s) [upload=27242]: Done uploading segments...
Aug 9 19:31:45.026753212 (26h5m39.457833343s) [upload=27242]: Upload finished. err: <nil>
Duration: 6.544592044s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X..............................X.................X.X.....] duration:
1.977334778s
FAIL (2025-08-09 19:36:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.977379645s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X..............................X.................X.X....] duration:
1.98005893s
FAIL (2025-08-09 19:36:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.980108676s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X..................X...........................X.X......] duration:
8.383929434s
FAIL (2025-08-09 19:35:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 19:31:39.969320940 (26h5m34.400401071s) [upload=27242]: Starting upload
Aug 9 19:31:39.969359324 (26h5m34.400439455s) [upload=27242]: Done starting upload
Aug 9 19:31:39.969456630 (26h5m34.400536761s) [upload=27242]: Uploading segments...
Aug 9 19:31:39.969557924 (26h5m34.400638055s) [upload=27242]: Got next segment. Inline: false
Aug 9 19:31:39.969586949 (26h5m34.40066708s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:31:39.969592861 (26h5m34.400673032s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:31:40.423036151 (26h5m34.854116282s) [seg_pos={0 0}, upload=27242]: Begin upload segment...
Aug 9 19:31:40.423082850 (26h5m34.854162981s) [seg_pos={0 0}, upload=27242]: Done begin upload segment.
Aug 9 19:31:40.423105053 (26h5m34.854185184s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423142424 (26h5m34.854222555s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423497523 (26h5m34.854577644s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423591874 (26h5m34.854672006s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423787018 (26h5m34.854867149s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423893642 (26h5m34.854973773s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424084347 (26h5m34.855164478s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424220457 (26h5m34.855300588s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424378258 (26h5m34.85545838s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424632546 (26h5m34.855712667s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424933993 (26h5m34.856014124s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425167709 (26h5m34.85624783s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425378573 (26h5m34.856458704s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425591419 (26h5m34.856671551s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425793367 (26h5m34.856873498s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426032654 (26h5m34.857112785s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426231294 (26h5m34.857311426s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426419895 (26h5m34.857500027s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:41.541363019 (26h5m35.97244315s) [upload=27242]: Next returned nil segment
Aug 9 19:31:41.541379470 (26h5m35.972459601s) [upload=27242]: Waiting for error group managing segments...
Aug 9 19:31:41.825362699 (26h5m36.25644283s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:41.853215159 (26h5m36.28429529s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.366836308 (26h5m36.797916439s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.442770694 (26h5m36.873850825s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.493054342 (26h5m36.924134503s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.496276868 (26h5m36.927356989s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.505091103 (26h5m36.936171234s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.561854769 (26h5m36.99293489s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.593180115 (26h5m37.024260246s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.622110047 (26h5m37.053190188s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.903832219 (26h5m37.33491235s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.088179587 (26h5m38.519259708s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.496775159 (26h5m38.92785529s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726859432 (26h5m39.157939563s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726903787 (26h5m39.157983918s) [seg_pos={0 0}, upload=27242]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:31:44.727357876 (26h5m39.158438007s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection
Aug 9 19:31:44.727407300 (26h5m39.158487431s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L5Mr53vCqKr4gy7N4rAaVCC9FvU8XdYKFrxWrJL728dt3LmR): protocol: rpc: dial tcp 104.36.82.43:4833: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727424704 (26h5m39.158504825s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SUeS7dkCCLwuiEW1U8X4vkbeejj7votE3hhKdgbBo1mUEa3Dd): protocol: write tcp 188.166.225.170:39062->104.36.82.62:4419: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727471663 (26h5m39.158551794s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: read tcp 188.166.225.170:33228->104.36.82.16:4300: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727490039 (26h5m39.15857017s) [seg_pos={0 0}, upload=27242]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:31:44.727563269 (26h5m39.1586434s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:31:44.727567407 (26h5m39.158647538s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:31:45.026735529 (26h5m39.45781565s) [upload=27242]: Done uploading segments...
Aug 9 19:31:45.026753212 (26h5m39.457833343s) [upload=27242]: Upload finished. err: <nil>
Duration: 8.383957568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X..................X...........................X.X.....] duration:
7.892040355s
FAIL (2025-08-09 19:35:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 19:31:39.969320940 (26h5m34.400401071s) [upload=27242]: Starting upload
Aug 9 19:31:39.969359324 (26h5m34.400439455s) [upload=27242]: Done starting upload
Aug 9 19:31:39.969456630 (26h5m34.400536761s) [upload=27242]: Uploading segments...
Aug 9 19:31:39.969557924 (26h5m34.400638055s) [upload=27242]: Got next segment. Inline: false
Aug 9 19:31:39.969586949 (26h5m34.40066708s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:31:39.969592861 (26h5m34.400673032s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:31:40.423036151 (26h5m34.854116282s) [seg_pos={0 0}, upload=27242]: Begin upload segment...
Aug 9 19:31:40.423082850 (26h5m34.854162981s) [seg_pos={0 0}, upload=27242]: Done begin upload segment.
Aug 9 19:31:40.423105053 (26h5m34.854185184s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423142424 (26h5m34.854222555s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423497523 (26h5m34.854577644s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423591874 (26h5m34.854672006s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423787018 (26h5m34.854867149s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423893642 (26h5m34.854973773s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424084347 (26h5m34.855164478s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424220457 (26h5m34.855300588s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424378258 (26h5m34.85545838s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424632546 (26h5m34.855712667s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424933993 (26h5m34.856014124s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425167709 (26h5m34.85624783s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425378573 (26h5m34.856458704s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425591419 (26h5m34.856671551s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425793367 (26h5m34.856873498s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426032654 (26h5m34.857112785s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426231294 (26h5m34.857311426s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426419895 (26h5m34.857500027s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:41.541363019 (26h5m35.97244315s) [upload=27242]: Next returned nil segment
Aug 9 19:31:41.541379470 (26h5m35.972459601s) [upload=27242]: Waiting for error group managing segments...
Aug 9 19:31:41.825362699 (26h5m36.25644283s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:41.853215159 (26h5m36.28429529s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.366836308 (26h5m36.797916439s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.442770694 (26h5m36.873850825s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.493054342 (26h5m36.924134503s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.496276868 (26h5m36.927356989s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.505091103 (26h5m36.936171234s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.561854769 (26h5m36.99293489s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.593180115 (26h5m37.024260246s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.622110047 (26h5m37.053190188s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.903832219 (26h5m37.33491235s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.088179587 (26h5m38.519259708s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.496775159 (26h5m38.92785529s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726859432 (26h5m39.157939563s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726903787 (26h5m39.157983918s) [seg_pos={0 0}, upload=27242]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:31:44.727357876 (26h5m39.158438007s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection
Aug 9 19:31:44.727407300 (26h5m39.158487431s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L5Mr53vCqKr4gy7N4rAaVCC9FvU8XdYKFrxWrJL728dt3LmR): protocol: rpc: dial tcp 104.36.82.43:4833: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727424704 (26h5m39.158504825s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SUeS7dkCCLwuiEW1U8X4vkbeejj7votE3hhKdgbBo1mUEa3Dd): protocol: write tcp 188.166.225.170:39062->104.36.82.62:4419: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727471663 (26h5m39.158551794s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: read tcp 188.166.225.170:33228->104.36.82.16:4300: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727490039 (26h5m39.15857017s) [seg_pos={0 0}, upload=27242]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:31:44.727563269 (26h5m39.1586434s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:31:44.727567407 (26h5m39.158647538s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:31:45.026735529 (26h5m39.45781565s) [upload=27242]: Done uploading segments...
Aug 9 19:31:45.026753212 (26h5m39.457833343s) [upload=27242]: Upload finished. err: <nil>
Duration: 7.892060676s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X..............................X.................X.X...] duration:
1.940883233s
FAIL (2025-08-09 19:34:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.940907239s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X..................X...........................X.X....] duration:
6.093141423s
FAIL (2025-08-09 19:34:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 19:31:39.969320940 (26h5m34.400401071s) [upload=27242]: Starting upload
Aug 9 19:31:39.969359324 (26h5m34.400439455s) [upload=27242]: Done starting upload
Aug 9 19:31:39.969456630 (26h5m34.400536761s) [upload=27242]: Uploading segments...
Aug 9 19:31:39.969557924 (26h5m34.400638055s) [upload=27242]: Got next segment. Inline: false
Aug 9 19:31:39.969586949 (26h5m34.40066708s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:31:39.969592861 (26h5m34.400673032s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:31:40.423036151 (26h5m34.854116282s) [seg_pos={0 0}, upload=27242]: Begin upload segment...
Aug 9 19:31:40.423082850 (26h5m34.854162981s) [seg_pos={0 0}, upload=27242]: Done begin upload segment.
Aug 9 19:31:40.423105053 (26h5m34.854185184s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423142424 (26h5m34.854222555s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423497523 (26h5m34.854577644s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423591874 (26h5m34.854672006s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423787018 (26h5m34.854867149s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423893642 (26h5m34.854973773s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424084347 (26h5m34.855164478s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424220457 (26h5m34.855300588s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424378258 (26h5m34.85545838s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424632546 (26h5m34.855712667s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424933993 (26h5m34.856014124s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425167709 (26h5m34.85624783s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425378573 (26h5m34.856458704s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425591419 (26h5m34.856671551s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425793367 (26h5m34.856873498s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426032654 (26h5m34.857112785s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426231294 (26h5m34.857311426s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426419895 (26h5m34.857500027s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:41.541363019 (26h5m35.97244315s) [upload=27242]: Next returned nil segment
Aug 9 19:31:41.541379470 (26h5m35.972459601s) [upload=27242]: Waiting for error group managing segments...
Aug 9 19:31:41.825362699 (26h5m36.25644283s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:41.853215159 (26h5m36.28429529s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.366836308 (26h5m36.797916439s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.442770694 (26h5m36.873850825s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.493054342 (26h5m36.924134503s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.496276868 (26h5m36.927356989s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.505091103 (26h5m36.936171234s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.561854769 (26h5m36.99293489s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.593180115 (26h5m37.024260246s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.622110047 (26h5m37.053190188s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.903832219 (26h5m37.33491235s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.088179587 (26h5m38.519259708s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.496775159 (26h5m38.92785529s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726859432 (26h5m39.157939563s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726903787 (26h5m39.157983918s) [seg_pos={0 0}, upload=27242]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:31:44.727357876 (26h5m39.158438007s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection
Aug 9 19:31:44.727407300 (26h5m39.158487431s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L5Mr53vCqKr4gy7N4rAaVCC9FvU8XdYKFrxWrJL728dt3LmR): protocol: rpc: dial tcp 104.36.82.43:4833: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727424704 (26h5m39.158504825s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SUeS7dkCCLwuiEW1U8X4vkbeejj7votE3hhKdgbBo1mUEa3Dd): protocol: write tcp 188.166.225.170:39062->104.36.82.62:4419: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727471663 (26h5m39.158551794s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: read tcp 188.166.225.170:33228->104.36.82.16:4300: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727490039 (26h5m39.15857017s) [seg_pos={0 0}, upload=27242]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:31:44.727563269 (26h5m39.1586434s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:31:44.727567407 (26h5m39.158647538s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:31:45.026735529 (26h5m39.45781565s) [upload=27242]: Done uploading segments...
Aug 9 19:31:45.026753212 (26h5m39.457833343s) [upload=27242]: Upload finished. err: <nil>
Duration: 6.093169267s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X..................X...........................X.X...] duration:
7.184895255s
FAIL (2025-08-09 19:34:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 19:31:39.969320940 (26h5m34.400401071s) [upload=27242]: Starting upload
Aug 9 19:31:39.969359324 (26h5m34.400439455s) [upload=27242]: Done starting upload
Aug 9 19:31:39.969456630 (26h5m34.400536761s) [upload=27242]: Uploading segments...
Aug 9 19:31:39.969557924 (26h5m34.400638055s) [upload=27242]: Got next segment. Inline: false
Aug 9 19:31:39.969586949 (26h5m34.40066708s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:31:39.969592861 (26h5m34.400673032s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:31:40.423036151 (26h5m34.854116282s) [seg_pos={0 0}, upload=27242]: Begin upload segment...
Aug 9 19:31:40.423082850 (26h5m34.854162981s) [seg_pos={0 0}, upload=27242]: Done begin upload segment.
Aug 9 19:31:40.423105053 (26h5m34.854185184s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423142424 (26h5m34.854222555s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423497523 (26h5m34.854577644s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423591874 (26h5m34.854672006s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423787018 (26h5m34.854867149s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423893642 (26h5m34.854973773s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424084347 (26h5m34.855164478s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424220457 (26h5m34.855300588s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424378258 (26h5m34.85545838s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424632546 (26h5m34.855712667s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424933993 (26h5m34.856014124s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425167709 (26h5m34.85624783s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425378573 (26h5m34.856458704s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425591419 (26h5m34.856671551s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425793367 (26h5m34.856873498s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426032654 (26h5m34.857112785s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426231294 (26h5m34.857311426s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426419895 (26h5m34.857500027s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:41.541363019 (26h5m35.97244315s) [upload=27242]: Next returned nil segment
Aug 9 19:31:41.541379470 (26h5m35.972459601s) [upload=27242]: Waiting for error group managing segments...
Aug 9 19:31:41.825362699 (26h5m36.25644283s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:41.853215159 (26h5m36.28429529s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.366836308 (26h5m36.797916439s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.442770694 (26h5m36.873850825s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.493054342 (26h5m36.924134503s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.496276868 (26h5m36.927356989s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.505091103 (26h5m36.936171234s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.561854769 (26h5m36.99293489s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.593180115 (26h5m37.024260246s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.622110047 (26h5m37.053190188s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.903832219 (26h5m37.33491235s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.088179587 (26h5m38.519259708s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.496775159 (26h5m38.92785529s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726859432 (26h5m39.157939563s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726903787 (26h5m39.157983918s) [seg_pos={0 0}, upload=27242]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:31:44.727357876 (26h5m39.158438007s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection
Aug 9 19:31:44.727407300 (26h5m39.158487431s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L5Mr53vCqKr4gy7N4rAaVCC9FvU8XdYKFrxWrJL728dt3LmR): protocol: rpc: dial tcp 104.36.82.43:4833: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727424704 (26h5m39.158504825s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SUeS7dkCCLwuiEW1U8X4vkbeejj7votE3hhKdgbBo1mUEa3Dd): protocol: write tcp 188.166.225.170:39062->104.36.82.62:4419: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727471663 (26h5m39.158551794s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: read tcp 188.166.225.170:33228->104.36.82.16:4300: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727490039 (26h5m39.15857017s) [seg_pos={0 0}, upload=27242]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:31:44.727563269 (26h5m39.1586434s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:31:44.727567407 (26h5m39.158647538s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:31:45.026735529 (26h5m39.45781565s) [upload=27242]: Done uploading segments...
Aug 9 19:31:45.026753212 (26h5m39.457833343s) [upload=27242]: Upload finished. err: <nil>
Duration: 7.184925603s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X..............................X.................X.X..] duration:
1.877508157s
FAIL (2025-08-09 19:34:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.877539066s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X..............................X.................X.X.] duration:
1.879295744s
FAIL (2025-08-09 19:33:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.879322617s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X..................X...........................X.X..] duration:
6.9731775s
FAIL (2025-08-09 19:33:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 19:31:39.969320940 (26h5m34.400401071s) [upload=27242]: Starting upload
Aug 9 19:31:39.969359324 (26h5m34.400439455s) [upload=27242]: Done starting upload
Aug 9 19:31:39.969456630 (26h5m34.400536761s) [upload=27242]: Uploading segments...
Aug 9 19:31:39.969557924 (26h5m34.400638055s) [upload=27242]: Got next segment. Inline: false
Aug 9 19:31:39.969586949 (26h5m34.40066708s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:31:39.969592861 (26h5m34.400673032s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:31:40.423036151 (26h5m34.854116282s) [seg_pos={0 0}, upload=27242]: Begin upload segment...
Aug 9 19:31:40.423082850 (26h5m34.854162981s) [seg_pos={0 0}, upload=27242]: Done begin upload segment.
Aug 9 19:31:40.423105053 (26h5m34.854185184s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423142424 (26h5m34.854222555s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423497523 (26h5m34.854577644s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423591874 (26h5m34.854672006s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423787018 (26h5m34.854867149s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423893642 (26h5m34.854973773s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424084347 (26h5m34.855164478s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424220457 (26h5m34.855300588s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424378258 (26h5m34.85545838s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424632546 (26h5m34.855712667s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424933993 (26h5m34.856014124s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425167709 (26h5m34.85624783s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425378573 (26h5m34.856458704s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425591419 (26h5m34.856671551s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425793367 (26h5m34.856873498s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426032654 (26h5m34.857112785s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426231294 (26h5m34.857311426s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426419895 (26h5m34.857500027s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:41.541363019 (26h5m35.97244315s) [upload=27242]: Next returned nil segment
Aug 9 19:31:41.541379470 (26h5m35.972459601s) [upload=27242]: Waiting for error group managing segments...
Aug 9 19:31:41.825362699 (26h5m36.25644283s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:41.853215159 (26h5m36.28429529s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.366836308 (26h5m36.797916439s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.442770694 (26h5m36.873850825s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.493054342 (26h5m36.924134503s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.496276868 (26h5m36.927356989s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.505091103 (26h5m36.936171234s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.561854769 (26h5m36.99293489s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.593180115 (26h5m37.024260246s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.622110047 (26h5m37.053190188s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.903832219 (26h5m37.33491235s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.088179587 (26h5m38.519259708s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.496775159 (26h5m38.92785529s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726859432 (26h5m39.157939563s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726903787 (26h5m39.157983918s) [seg_pos={0 0}, upload=27242]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:31:44.727357876 (26h5m39.158438007s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection
Aug 9 19:31:44.727407300 (26h5m39.158487431s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L5Mr53vCqKr4gy7N4rAaVCC9FvU8XdYKFrxWrJL728dt3LmR): protocol: rpc: dial tcp 104.36.82.43:4833: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727424704 (26h5m39.158504825s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SUeS7dkCCLwuiEW1U8X4vkbeejj7votE3hhKdgbBo1mUEa3Dd): protocol: write tcp 188.166.225.170:39062->104.36.82.62:4419: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727471663 (26h5m39.158551794s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: read tcp 188.166.225.170:33228->104.36.82.16:4300: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727490039 (26h5m39.15857017s) [seg_pos={0 0}, upload=27242]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:31:44.727563269 (26h5m39.1586434s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:31:44.727567407 (26h5m39.158647538s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:31:45.026735529 (26h5m39.45781565s) [upload=27242]: Done uploading segments...
Aug 9 19:31:45.026753212 (26h5m39.457833343s) [upload=27242]: Upload finished. err: <nil>
Duration: 6.973204792s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X..............................X.................X.X] duration:
866.592674ms
FAIL (2025-08-09 19:32:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 866.61715ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X..................X...........................X.X.] duration:
6.153312732s
FAIL (2025-08-09 19:32:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 19:31:39.969320940 (26h5m34.400401071s) [upload=27242]: Starting upload
Aug 9 19:31:39.969359324 (26h5m34.400439455s) [upload=27242]: Done starting upload
Aug 9 19:31:39.969456630 (26h5m34.400536761s) [upload=27242]: Uploading segments...
Aug 9 19:31:39.969557924 (26h5m34.400638055s) [upload=27242]: Got next segment. Inline: false
Aug 9 19:31:39.969586949 (26h5m34.40066708s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:31:39.969592861 (26h5m34.400673032s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:31:40.423036151 (26h5m34.854116282s) [seg_pos={0 0}, upload=27242]: Begin upload segment...
Aug 9 19:31:40.423082850 (26h5m34.854162981s) [seg_pos={0 0}, upload=27242]: Done begin upload segment.
Aug 9 19:31:40.423105053 (26h5m34.854185184s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423142424 (26h5m34.854222555s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423497523 (26h5m34.854577644s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423591874 (26h5m34.854672006s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423787018 (26h5m34.854867149s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423893642 (26h5m34.854973773s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424084347 (26h5m34.855164478s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424220457 (26h5m34.855300588s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424378258 (26h5m34.85545838s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424632546 (26h5m34.855712667s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424933993 (26h5m34.856014124s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425167709 (26h5m34.85624783s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425378573 (26h5m34.856458704s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425591419 (26h5m34.856671551s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425793367 (26h5m34.856873498s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426032654 (26h5m34.857112785s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426231294 (26h5m34.857311426s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426419895 (26h5m34.857500027s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:41.541363019 (26h5m35.97244315s) [upload=27242]: Next returned nil segment
Aug 9 19:31:41.541379470 (26h5m35.972459601s) [upload=27242]: Waiting for error group managing segments...
Aug 9 19:31:41.825362699 (26h5m36.25644283s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:41.853215159 (26h5m36.28429529s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.366836308 (26h5m36.797916439s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.442770694 (26h5m36.873850825s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.493054342 (26h5m36.924134503s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.496276868 (26h5m36.927356989s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.505091103 (26h5m36.936171234s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.561854769 (26h5m36.99293489s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.593180115 (26h5m37.024260246s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.622110047 (26h5m37.053190188s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.903832219 (26h5m37.33491235s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.088179587 (26h5m38.519259708s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.496775159 (26h5m38.92785529s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726859432 (26h5m39.157939563s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726903787 (26h5m39.157983918s) [seg_pos={0 0}, upload=27242]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:31:44.727357876 (26h5m39.158438007s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection
Aug 9 19:31:44.727407300 (26h5m39.158487431s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L5Mr53vCqKr4gy7N4rAaVCC9FvU8XdYKFrxWrJL728dt3LmR): protocol: rpc: dial tcp 104.36.82.43:4833: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727424704 (26h5m39.158504825s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SUeS7dkCCLwuiEW1U8X4vkbeejj7votE3hhKdgbBo1mUEa3Dd): protocol: write tcp 188.166.225.170:39062->104.36.82.62:4419: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727471663 (26h5m39.158551794s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: read tcp 188.166.225.170:33228->104.36.82.16:4300: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727490039 (26h5m39.15857017s) [seg_pos={0 0}, upload=27242]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:31:44.727563269 (26h5m39.1586434s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:31:44.727567407 (26h5m39.158647538s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:31:45.026735529 (26h5m39.45781565s) [upload=27242]: Done uploading segments...
Aug 9 19:31:45.026753212 (26h5m39.457833343s) [upload=27242]: Upload finished. err: <nil>
Duration: 6.153352888s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X..............................X.................X.] duration:
1.853165583s
FAIL (2025-08-09 19:31:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9d13694a32f7e8c6ae4c0c4fdb1154314bf844296b6681cbc69ae1907a2a43a3 != before 77f5c6109ed6fcd7a4173e1a03ca49b3a82a3bcdc2d550345abb57fb11cb0f7f ======LOGS====== Aug 9 19:31:21.193060736 (26h5m15.624140867s) [upload=27239]: Starting upload Aug 9 19:31:21.193131441 (26h5m15.624211573s) [upload=27239]: Done starting upload Aug 9 19:31:21.193195013 (26h5m15.624275144s) [upload=27239]: Uploading segments... Aug 9 19:31:21.193239047 (26h5m15.624319179s) [upload=27239]: Got next segment. Inline: true Aug 9 19:31:21.193246141 (26h5m15.624326282s) [upload=27239]: Waiting for error group managing segments... Aug 9 19:31:21.193288893 (26h5m15.624369024s) [upload=27239]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:31:21.193294353 (26h5m15.624374484s) [upload=27239]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:31:21.193298000 (26h5m15.624378131s) [upload=27239]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:31:21.695360141 (26h5m16.126440272s) [upload=27239]: Done uploading segments... Aug 9 19:31:21.695378756 (26h5m16.126458887s) [upload=27239]: Upload finished. err: <nil>
Duration: 1.85319649s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X..................X...........................X.X] duration:
6.443184951s
FAIL (2025-08-09 19:31:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 19:31:39.969320940 (26h5m34.400401071s) [upload=27242]: Starting upload
Aug 9 19:31:39.969359324 (26h5m34.400439455s) [upload=27242]: Done starting upload
Aug 9 19:31:39.969456630 (26h5m34.400536761s) [upload=27242]: Uploading segments...
Aug 9 19:31:39.969557924 (26h5m34.400638055s) [upload=27242]: Got next segment. Inline: false
Aug 9 19:31:39.969586949 (26h5m34.40066708s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:31:39.969592861 (26h5m34.400673032s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:31:40.423036151 (26h5m34.854116282s) [seg_pos={0 0}, upload=27242]: Begin upload segment...
Aug 9 19:31:40.423082850 (26h5m34.854162981s) [seg_pos={0 0}, upload=27242]: Done begin upload segment.
Aug 9 19:31:40.423105053 (26h5m34.854185184s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423142424 (26h5m34.854222555s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423497523 (26h5m34.854577644s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423591874 (26h5m34.854672006s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423787018 (26h5m34.854867149s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.423893642 (26h5m34.854973773s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424084347 (26h5m34.855164478s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424220457 (26h5m34.855300588s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424378258 (26h5m34.85545838s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424632546 (26h5m34.855712667s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.424933993 (26h5m34.856014124s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425167709 (26h5m34.85624783s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425378573 (26h5m34.856458704s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425591419 (26h5m34.856671551s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.425793367 (26h5m34.856873498s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426032654 (26h5m34.857112785s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426231294 (26h5m34.857311426s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:40.426419895 (26h5m34.857500027s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Uploading piece...
Aug 9 19:31:41.541363019 (26h5m35.97244315s) [upload=27242]: Next returned nil segment
Aug 9 19:31:41.541379470 (26h5m35.972459601s) [upload=27242]: Waiting for error group managing segments...
Aug 9 19:31:41.825362699 (26h5m36.25644283s) [noise=true , address=64.49.13.155:4915 , piece_id=743MX3I5WAGMFFK7F2XFZQLNOJN4HGYIDO2LKFUAHV5AMQ4H226A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:41.853215159 (26h5m36.28429529s) [noise=true , address=64.49.13.155:4914 , piece_id=D7GKFJO7TIC2FW2MW4O7C6OW5U3XR75YBCU2MF3AHV4QWXMEAS7A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.366836308 (26h5m36.797916439s) [noise=true , address=79.127.219.51:4196 , piece_id=3GSOCOY3EDW3GANUV3D2M4IGVOMHVX6RPK757NPVQAPFJ7H74FVA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.442770694 (26h5m36.873850825s) [noise=true , address=104.36.82.37:4686 , piece_id=NO7IRQ4JGAVLOVGDIGNLQM6YGYHYTATB6OLILTW3VMDQTR5LTP6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.493054342 (26h5m36.924134503s) [noise=true , address=104.36.82.45:4918 , piece_id=RAUHXUJBT5XB5W2HDKWLDRGX2GIUIICSAODLMXXGJJHPDXNVSO4Q, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.496276868 (26h5m36.927356989s) [noise=true , address=104.36.82.6:4905 , piece_id=I5Z5LDJ22655TCW2ORQ3B223KGMNOAXY66UZLVXUA3AOVSBWP6NA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.505091103 (26h5m36.936171234s) [noise=true , address=104.36.82.12:4161 , piece_id=ADAO4KAVQV5YZBKLVI76GFUSNCXUYHZS7RFUS26SYDPE2ASFRD6A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.561854769 (26h5m36.99293489s) [noise=true , address=104.36.82.58:4300 , piece_id=VHIMEEPDDEDYU2L4YHUAPBY453JRPQKNUV6IZR4TYMJS7FED3U4A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.593180115 (26h5m37.024260246s) [noise=true , address=104.36.82.41:4778 , piece_id=HB2ORJXW4G5KO6ZWLPDWB3YRCMLZD5MSDVHYTSTX2UV4UPGEEPXQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.622110047 (26h5m37.053190188s) [noise=true , address=104.36.82.56:4235 , piece_id=BDQOW7A2MA3G3J24JRGSSOUTKNIUOJJ2D7KEXQIDGN22QYDVACHQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:42.903832219 (26h5m37.33491235s) [noise=true , address=104.36.82.59:4307 , piece_id=KTWWLAG5FRXP6SZCHTE6QADWIM7WCZLBZ3XRJCKG5XKAFMZ5Z4YQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.088179587 (26h5m38.519259708s) [noise=true , address=104.36.82.39:4745 , piece_id=EUY2BF4VRVV4YLEKQD5X5JRLVXSN7S5BDRS7VKSELPVG4IQIUUHA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.496775159 (26h5m38.92785529s) [noise=true , address=104.36.82.47:4519 , piece_id=2TYD3GCOGMG7KSMYHHIOUKW4MREB456VMIGEWIZ5FK2P6HZJG5MA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726859432 (26h5m39.157939563s) [noise=true , address=104.36.82.60:4359 , piece_id=IEJOTIS3N6WDCURZUXEUDVHWBCQR5SOQH4YXENL6FUUBT5TTLDKQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: <nil>
Aug 9 19:31:44.726903787 (26h5m39.157983918s) [seg_pos={0 0}, upload=27242]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:31:44.727357876 (26h5m39.158438007s) [noise=true , address=104.36.82.5:4855 , piece_id=5QWAMENIR7K4Z6AHYGVBWKTYAPSFSFTYBDPV5U7ZX6TKJFQYE2EA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44382->104.36.82.5:4855: use of closed network connection
Aug 9 19:31:44.727407300 (26h5m39.158487431s) [noise=true , address=104.36.82.43:4833 , piece_id=HHV3KFNJPUVEZGDUGJKXCQMW2PKUHR4L3K56UOOJYKJBMWVAFJNA, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L5Mr53vCqKr4gy7N4rAaVCC9FvU8XdYKFrxWrJL728dt3LmR): protocol: rpc: dial tcp 104.36.82.43:4833: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727424704 (26h5m39.158504825s) [noise=true , address=104.36.82.62:4419 , piece_id=BFWM36WKAPZW4PY6J2PWJ6LN3O6TSF6PWFTC2DXUL44B7UYYF4JQ, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SUeS7dkCCLwuiEW1U8X4vkbeejj7votE3hhKdgbBo1mUEa3Dd): protocol: write tcp 188.166.225.170:39062->104.36.82.62:4419: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727471663 (26h5m39.158551794s) [noise=true , address=104.36.82.16:4300 , piece_id=KS4C3QE7B3GOZWRHGQ3ULRGHFG4P3GQLQM6B7SZ6UZADJKC2VI2A, seg_pos={0 0}, upload=27242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: read tcp 188.166.225.170:33228->104.36.82.16:4300: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:31:44.727490039 (26h5m39.15857017s) [seg_pos={0 0}, upload=27242]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:31:44.727563269 (26h5m39.1586434s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:31:44.727567407 (26h5m39.158647538s) [upload=27242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:31:45.026735529 (26h5m39.45781565s) [upload=27242]: Done uploading segments...
Aug 9 19:31:45.026753212 (26h5m39.457833343s) [upload=27242]: Upload finished. err: <nil>
Duration: 6.443206131s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X..............................X.................X] duration:
1.86788069s
FAIL (2025-08-09 19:31:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9d13694a32f7e8c6ae4c0c4fdb1154314bf844296b6681cbc69ae1907a2a43a3 != before 77f5c6109ed6fcd7a4173e1a03ca49b3a82a3bcdc2d550345abb57fb11cb0f7f ======LOGS====== Aug 9 19:31:21.193060736 (26h5m15.624140867s) [upload=27239]: Starting upload Aug 9 19:31:21.193131441 (26h5m15.624211573s) [upload=27239]: Done starting upload Aug 9 19:31:21.193195013 (26h5m15.624275144s) [upload=27239]: Uploading segments... Aug 9 19:31:21.193239047 (26h5m15.624319179s) [upload=27239]: Got next segment. Inline: true Aug 9 19:31:21.193246141 (26h5m15.624326282s) [upload=27239]: Waiting for error group managing segments... Aug 9 19:31:21.193288893 (26h5m15.624369024s) [upload=27239]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:31:21.193294353 (26h5m15.624374484s) [upload=27239]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:31:21.193298000 (26h5m15.624378131s) [upload=27239]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:31:21.695360141 (26h5m16.126440272s) [upload=27239]: Done uploading segments... Aug 9 19:31:21.695378756 (26h5m16.126458887s) [upload=27239]: Upload finished. err: <nil>
Duration: 1.867913532s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X..................X...........................X.] duration:
6.823731208s
FAIL (2025-08-09 19:30:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 4deb051a5f9b799a43ed229712dc28538803c360736ed50782d9dc80833b3f5e != before 3fdf49edf0d186a230eb1f06a687b0b6035425b4e908e78f00b20303a4abe6ab
======LOGS======
Aug 9 19:29:50.934992915 (26h3m45.366073046s) [upload=27208]: Starting upload
Aug 9 19:29:50.935042660 (26h3m45.366122781s) [upload=27208]: Done starting upload
Aug 9 19:29:50.935143634 (26h3m45.366223765s) [upload=27208]: Uploading segments...
Aug 9 19:29:50.935235128 (26h3m45.366315259s) [upload=27208]: Got next segment. Inline: false
Aug 9 19:29:50.935298780 (26h3m45.366378911s) [upload=27208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:29:50.935303690 (26h3m45.366383821s) [upload=27208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:29:51.397121211 (26h3m45.828201332s) [seg_pos={0 0}, upload=27208]: Begin upload segment...
Aug 9 19:29:51.397159054 (26h3m45.828239185s) [seg_pos={0 0}, upload=27208]: Done begin upload segment.
Aug 9 19:29:51.397191265 (26h3m45.828271386s) [noise=true , address=104.36.82.46:4501 , piece_id=5U3RTSYYITVDRHSN3H74N37CJVS3XUI643N2FFVYXMVILZCGJSVA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.397198479 (26h3m45.8282786s) [noise=true , address=104.36.82.2:4752 , piece_id=FLIPRRQZLL43FUJLHKNGDW2QWOBT6OVKDSIQOPTMAJ5FTDKT5NVA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.397570611 (26h3m45.828650742s) [noise=true , address=104.36.82.35:4602 , piece_id=NA6VAMNQXJXB4HIUO32JEGLBVM7PVJYYIIUA5PFPYRBVMR2IWEEA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.397641647 (26h3m45.828721778s) [noise=true , address=79.127.205.234:4589 , piece_id=VF7C3ECPJ52RF6ZXRBZFKF6KKIMWCOJIZNF7BWA62GOSSKUOP6JQ, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.397852590 (26h3m45.828932722s) [noise=true , address=104.36.82.14:4255 , piece_id=ZSCQHXMC74RJPG4JPB4COBEKGRRAPFYFPDTR3MXBKWTSECRSVMPA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.398005604 (26h3m45.829085735s) [noise=true , address=104.36.82.39:4757 , piece_id=LO2A77NNI47MQCZWQH6QM52LJRWMZEDBGXWKDTCUZU343I3PLBLA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.398160059 (26h3m45.82924019s) [noise=true , address=104.36.82.9:4035 , piece_id=RFQMNW6MNWWCYK5P5ZKIKSKD72Q7UAFV5RJL72BIK5NJNTE24XLQ, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.398332438 (26h3m45.829412569s) [noise=true , address=104.36.82.23:4454 , piece_id=35NF73MAAJCDYT5VUGJUNUAAVUHM62KMO6XRZTFIFGZ7RXZOAECA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.398595853 (26h3m45.829675984s) [noise=true , address=104.36.82.20:4454 , piece_id=APSJYWRKCRUGVMCPBWUD5QHC75SMKTF7LZ7K444TRXMZCK4DWFLQ, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.398959749 (26h3m45.83003987s) [noise=true , address=104.36.82.34:4548 , piece_id=L5JDQNAKIE5R4BKFVDO2NGLLLB4EK4JG6K7RZGNCRAMH5JJTX3RA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.399180000 (26h3m45.830260131s) [noise=true , address=104.36.82.37:4683 , piece_id=VRWXHWU5A26QKH7YU3P73Q7FL4LXYIYGKN2M3KOMSL72J7MMVMPA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.399381356 (26h3m45.830461487s) [noise=true , address=64.49.13.27:4965 , piece_id=LMQKQ3V6ZHLH5GOOSW2O3TI25Q3QLUHT6BNG7WK2ZUBPDT5MUACQ, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.399575698 (26h3m45.830655829s) [noise=true , address=104.36.82.12:4176 , piece_id=TNM26LZBR5XQQAXVHQCRRNQUWRIR26TTQEJMLL4XJXHJ4HUT45AA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.399780609 (26h3m45.83086074s) [noise=true , address=64.49.13.138:4492 , piece_id=JFPMYZETFACHX7BJD3GNXCHTGZFAYV2JCCIVD6OOCJJ52KHTZT7Q, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.399973098 (26h3m45.831053229s) [noise=true , address=104.36.82.17:4353 , piece_id=MB7DF4CMAO4ZQFNPBIJUH3YRZKSWPDTZHMNCLIMFMQ52QO7GJCJA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.400207917 (26h3m45.831288048s) [noise=true , address=104.36.82.43:4835 , piece_id=O55T2IZVUZRU2PSGTOU4HISEV34J3DSV5CA3FSMNKHUPEJVB5UWQ, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.400413330 (26h3m45.831493461s) [noise=true , address=104.36.82.4:4821 , piece_id=F4YHOI2HRPPV2OPUUC7VNWVA6IKU7NL5UIOC75GKHPANHDWR7NJA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.406126782 (26h3m45.837206913s) [noise=true , address=104.36.82.47:4552 , piece_id=Q6X243KAKPND56LNJMBNYKBIHATSGWINOJSLMMHVK5JSZKICQPDA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:52.491574754 (26h3m46.922654885s) [upload=27208]: Next returned nil segment
Aug 9 19:29:52.491591216 (26h3m46.922671347s) [upload=27208]: Waiting for error group managing segments...
Aug 9 19:29:52.788098156 (26h3m47.219178287s) [noise=true , address=64.49.13.27:4965 , piece_id=LMQKQ3V6ZHLH5GOOSW2O3TI25Q3QLUHT6BNG7WK2ZUBPDT5MUACQ, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:52.825280558 (26h3m47.256360689s) [noise=true , address=79.127.205.234:4589 , piece_id=VF7C3ECPJ52RF6ZXRBZFKF6KKIMWCOJIZNF7BWA62GOSSKUOP6JQ, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:52.831721962 (26h3m47.262802093s) [noise=true , address=64.49.13.138:4492 , piece_id=JFPMYZETFACHX7BJD3GNXCHTGZFAYV2JCCIVD6OOCJJ52KHTZT7Q, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.363986681 (26h3m47.795066812s) [noise=true , address=104.36.82.46:4501 , piece_id=5U3RTSYYITVDRHSN3H74N37CJVS3XUI643N2FFVYXMVILZCGJSVA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.384050219 (26h3m47.81513039s) [noise=true , address=104.36.82.4:4821 , piece_id=F4YHOI2HRPPV2OPUUC7VNWVA6IKU7NL5UIOC75GKHPANHDWR7NJA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.394339395 (26h3m47.825419546s) [noise=true , address=104.36.82.9:4035 , piece_id=RFQMNW6MNWWCYK5P5ZKIKSKD72Q7UAFV5RJL72BIK5NJNTE24XLQ, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.460192172 (26h3m47.891272323s) [noise=true , address=104.36.82.2:4752 , piece_id=FLIPRRQZLL43FUJLHKNGDW2QWOBT6OVKDSIQOPTMAJ5FTDKT5NVA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.512625103 (26h3m47.943705254s) [noise=true , address=104.36.82.20:4454 , piece_id=APSJYWRKCRUGVMCPBWUD5QHC75SMKTF7LZ7K444TRXMZCK4DWFLQ, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.526112920 (26h3m47.957193051s) [noise=true , address=104.36.82.35:4602 , piece_id=NA6VAMNQXJXB4HIUO32JEGLBVM7PVJYYIIUA5PFPYRBVMR2IWEEA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.546696212 (26h3m47.977776343s) [noise=true , address=104.36.82.23:4454 , piece_id=35NF73MAAJCDYT5VUGJUNUAAVUHM62KMO6XRZTFIFGZ7RXZOAECA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.653231367 (26h3m48.084311498s) [noise=true , address=104.36.82.14:4255 , piece_id=ZSCQHXMC74RJPG4JPB4COBEKGRRAPFYFPDTR3MXBKWTSECRSVMPA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.764518163 (26h3m48.195598294s) [noise=true , address=104.36.82.47:4552 , piece_id=Q6X243KAKPND56LNJMBNYKBIHATSGWINOJSLMMHVK5JSZKICQPDA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.827382432 (26h3m48.258462553s) [noise=true , address=104.36.82.37:4683 , piece_id=VRWXHWU5A26QKH7YU3P73Q7FL4LXYIYGKN2M3KOMSL72J7MMVMPA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:54.018245753 (26h3m48.449325884s) [noise=true , address=104.36.82.34:4548 , piece_id=L5JDQNAKIE5R4BKFVDO2NGLLLB4EK4JG6K7RZGNCRAMH5JJTX3RA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:54.018271312 (26h3m48.449351443s) [seg_pos={0 0}, upload=27208]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:29:54.018422743 (26h3m48.449502874s) [noise=true , address=104.36.82.12:4176 , piece_id=TNM26LZBR5XQQAXVHQCRRNQUWRIR26TTQEJMLL4XJXHJ4HUT45AA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kGgrsNn5tv2GkcuVHHArCACwRB2qwbj3X3JmzVF4UL6dLRW1m): protocol: expected piece hash; context canceled; EOF
Aug 9 19:29:54.018582378 (26h3m48.449662509s) [noise=true , address=104.36.82.43:4835 , piece_id=O55T2IZVUZRU2PSGTOU4HISEV34J3DSV5CA3FSMNKHUPEJVB5UWQ, seg_pos={0 0}, upload=27208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: write tcp 188.166.225.170:48730->104.36.82.43:4835: use of closed network connection; write tcp 188.166.225.170:48730->104.36.82.43:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48730->104.36.82.43:4835: use of closed network connection
Aug 9 19:29:54.018625660 (26h3m48.449705792s) [noise=true , address=104.36.82.39:4757 , piece_id=LO2A77NNI47MQCZWQH6QM52LJRWMZEDBGXWKDTCUZU343I3PLBLA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18M8G3TUJ9jLNDnWMpYaQBXfBUXpD7hzf4Xt6BzasYNnsfTWxS): protocol: write tcp 188.166.225.170:57952->104.36.82.39:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:29:54.018683611 (26h3m48.449763762s) [noise=true , address=104.36.82.17:4353 , piece_id=MB7DF4CMAO4ZQFNPBIJUH3YRZKSWPDTZHMNCLIMFMQ52QO7GJCJA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HRqnFXL5isiFtNS4hFRidH2vchEYTvTLeiA8rbYxfVfaygn8J): protocol: read tcp 188.166.225.170:55458->104.36.82.17:4353: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:29:54.018724270 (26h3m48.449804421s) [seg_pos={0 0}, upload=27208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:29:54.018804153 (26h3m48.449884284s) [upload=27208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:29:54.018808521 (26h3m48.449888642s) [upload=27208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:29:54.975161614 (26h3m49.406241745s) [upload=27208]: Done uploading segments...
Aug 9 19:29:54.975182294 (26h3m49.406262425s) [upload=27208]: Upload finished. err: <nil>
Duration: 6.823769782s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X..............................X.................] duration:
1.843359917s
FAIL (2025-08-09 19:30:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 19:15:59.518233402 (25h49m53.949313533s) [upload=26968]: Starting upload
Aug 9 19:15:59.518279018 (25h49m53.94935915s) [upload=26968]: Done starting upload
Aug 9 19:15:59.518329355 (25h49m53.949409476s) [upload=26968]: Uploading segments...
Aug 9 19:15:59.518363781 (25h49m53.949443912s) [upload=26968]: Got next segment. Inline: true
Aug 9 19:15:59.518368620 (25h49m53.949448741s) [upload=26968]: Waiting for error group managing segments...
Aug 9 19:15:59.518404810 (25h49m53.949484941s) [upload=26968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:15:59.518408907 (25h49m53.949489038s) [upload=26968]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 19:15:59.518411412 (25h49m53.949491533s) [upload=26968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:15:59.799639028 (25h49m54.230719159s) [upload=26968]: Done uploading segments...
Aug 9 19:15:59.799658085 (25h49m54.230738216s) [upload=26968]: Upload finished. err: <nil>
Duration: 1.843389784s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X..................X...........................X] duration:
7.458808386s
FAIL (2025-08-09 19:29:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 4deb051a5f9b799a43ed229712dc28538803c360736ed50782d9dc80833b3f5e != before 3fdf49edf0d186a230eb1f06a687b0b6035425b4e908e78f00b20303a4abe6ab
======LOGS======
Aug 9 19:29:50.934992915 (26h3m45.366073046s) [upload=27208]: Starting upload
Aug 9 19:29:50.935042660 (26h3m45.366122781s) [upload=27208]: Done starting upload
Aug 9 19:29:50.935143634 (26h3m45.366223765s) [upload=27208]: Uploading segments...
Aug 9 19:29:50.935235128 (26h3m45.366315259s) [upload=27208]: Got next segment. Inline: false
Aug 9 19:29:50.935298780 (26h3m45.366378911s) [upload=27208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:29:50.935303690 (26h3m45.366383821s) [upload=27208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:29:51.397121211 (26h3m45.828201332s) [seg_pos={0 0}, upload=27208]: Begin upload segment...
Aug 9 19:29:51.397159054 (26h3m45.828239185s) [seg_pos={0 0}, upload=27208]: Done begin upload segment.
Aug 9 19:29:51.397191265 (26h3m45.828271386s) [noise=true , address=104.36.82.46:4501 , piece_id=5U3RTSYYITVDRHSN3H74N37CJVS3XUI643N2FFVYXMVILZCGJSVA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.397198479 (26h3m45.8282786s) [noise=true , address=104.36.82.2:4752 , piece_id=FLIPRRQZLL43FUJLHKNGDW2QWOBT6OVKDSIQOPTMAJ5FTDKT5NVA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.397570611 (26h3m45.828650742s) [noise=true , address=104.36.82.35:4602 , piece_id=NA6VAMNQXJXB4HIUO32JEGLBVM7PVJYYIIUA5PFPYRBVMR2IWEEA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.397641647 (26h3m45.828721778s) [noise=true , address=79.127.205.234:4589 , piece_id=VF7C3ECPJ52RF6ZXRBZFKF6KKIMWCOJIZNF7BWA62GOSSKUOP6JQ, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.397852590 (26h3m45.828932722s) [noise=true , address=104.36.82.14:4255 , piece_id=ZSCQHXMC74RJPG4JPB4COBEKGRRAPFYFPDTR3MXBKWTSECRSVMPA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.398005604 (26h3m45.829085735s) [noise=true , address=104.36.82.39:4757 , piece_id=LO2A77NNI47MQCZWQH6QM52LJRWMZEDBGXWKDTCUZU343I3PLBLA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.398160059 (26h3m45.82924019s) [noise=true , address=104.36.82.9:4035 , piece_id=RFQMNW6MNWWCYK5P5ZKIKSKD72Q7UAFV5RJL72BIK5NJNTE24XLQ, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.398332438 (26h3m45.829412569s) [noise=true , address=104.36.82.23:4454 , piece_id=35NF73MAAJCDYT5VUGJUNUAAVUHM62KMO6XRZTFIFGZ7RXZOAECA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.398595853 (26h3m45.829675984s) [noise=true , address=104.36.82.20:4454 , piece_id=APSJYWRKCRUGVMCPBWUD5QHC75SMKTF7LZ7K444TRXMZCK4DWFLQ, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.398959749 (26h3m45.83003987s) [noise=true , address=104.36.82.34:4548 , piece_id=L5JDQNAKIE5R4BKFVDO2NGLLLB4EK4JG6K7RZGNCRAMH5JJTX3RA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.399180000 (26h3m45.830260131s) [noise=true , address=104.36.82.37:4683 , piece_id=VRWXHWU5A26QKH7YU3P73Q7FL4LXYIYGKN2M3KOMSL72J7MMVMPA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.399381356 (26h3m45.830461487s) [noise=true , address=64.49.13.27:4965 , piece_id=LMQKQ3V6ZHLH5GOOSW2O3TI25Q3QLUHT6BNG7WK2ZUBPDT5MUACQ, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.399575698 (26h3m45.830655829s) [noise=true , address=104.36.82.12:4176 , piece_id=TNM26LZBR5XQQAXVHQCRRNQUWRIR26TTQEJMLL4XJXHJ4HUT45AA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.399780609 (26h3m45.83086074s) [noise=true , address=64.49.13.138:4492 , piece_id=JFPMYZETFACHX7BJD3GNXCHTGZFAYV2JCCIVD6OOCJJ52KHTZT7Q, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.399973098 (26h3m45.831053229s) [noise=true , address=104.36.82.17:4353 , piece_id=MB7DF4CMAO4ZQFNPBIJUH3YRZKSWPDTZHMNCLIMFMQ52QO7GJCJA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.400207917 (26h3m45.831288048s) [noise=true , address=104.36.82.43:4835 , piece_id=O55T2IZVUZRU2PSGTOU4HISEV34J3DSV5CA3FSMNKHUPEJVB5UWQ, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.400413330 (26h3m45.831493461s) [noise=true , address=104.36.82.4:4821 , piece_id=F4YHOI2HRPPV2OPUUC7VNWVA6IKU7NL5UIOC75GKHPANHDWR7NJA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:51.406126782 (26h3m45.837206913s) [noise=true , address=104.36.82.47:4552 , piece_id=Q6X243KAKPND56LNJMBNYKBIHATSGWINOJSLMMHVK5JSZKICQPDA, seg_pos={0 0}, upload=27208]: Uploading piece...
Aug 9 19:29:52.491574754 (26h3m46.922654885s) [upload=27208]: Next returned nil segment
Aug 9 19:29:52.491591216 (26h3m46.922671347s) [upload=27208]: Waiting for error group managing segments...
Aug 9 19:29:52.788098156 (26h3m47.219178287s) [noise=true , address=64.49.13.27:4965 , piece_id=LMQKQ3V6ZHLH5GOOSW2O3TI25Q3QLUHT6BNG7WK2ZUBPDT5MUACQ, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:52.825280558 (26h3m47.256360689s) [noise=true , address=79.127.205.234:4589 , piece_id=VF7C3ECPJ52RF6ZXRBZFKF6KKIMWCOJIZNF7BWA62GOSSKUOP6JQ, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:52.831721962 (26h3m47.262802093s) [noise=true , address=64.49.13.138:4492 , piece_id=JFPMYZETFACHX7BJD3GNXCHTGZFAYV2JCCIVD6OOCJJ52KHTZT7Q, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.363986681 (26h3m47.795066812s) [noise=true , address=104.36.82.46:4501 , piece_id=5U3RTSYYITVDRHSN3H74N37CJVS3XUI643N2FFVYXMVILZCGJSVA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.384050219 (26h3m47.81513039s) [noise=true , address=104.36.82.4:4821 , piece_id=F4YHOI2HRPPV2OPUUC7VNWVA6IKU7NL5UIOC75GKHPANHDWR7NJA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.394339395 (26h3m47.825419546s) [noise=true , address=104.36.82.9:4035 , piece_id=RFQMNW6MNWWCYK5P5ZKIKSKD72Q7UAFV5RJL72BIK5NJNTE24XLQ, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.460192172 (26h3m47.891272323s) [noise=true , address=104.36.82.2:4752 , piece_id=FLIPRRQZLL43FUJLHKNGDW2QWOBT6OVKDSIQOPTMAJ5FTDKT5NVA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.512625103 (26h3m47.943705254s) [noise=true , address=104.36.82.20:4454 , piece_id=APSJYWRKCRUGVMCPBWUD5QHC75SMKTF7LZ7K444TRXMZCK4DWFLQ, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.526112920 (26h3m47.957193051s) [noise=true , address=104.36.82.35:4602 , piece_id=NA6VAMNQXJXB4HIUO32JEGLBVM7PVJYYIIUA5PFPYRBVMR2IWEEA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.546696212 (26h3m47.977776343s) [noise=true , address=104.36.82.23:4454 , piece_id=35NF73MAAJCDYT5VUGJUNUAAVUHM62KMO6XRZTFIFGZ7RXZOAECA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.653231367 (26h3m48.084311498s) [noise=true , address=104.36.82.14:4255 , piece_id=ZSCQHXMC74RJPG4JPB4COBEKGRRAPFYFPDTR3MXBKWTSECRSVMPA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.764518163 (26h3m48.195598294s) [noise=true , address=104.36.82.47:4552 , piece_id=Q6X243KAKPND56LNJMBNYKBIHATSGWINOJSLMMHVK5JSZKICQPDA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:53.827382432 (26h3m48.258462553s) [noise=true , address=104.36.82.37:4683 , piece_id=VRWXHWU5A26QKH7YU3P73Q7FL4LXYIYGKN2M3KOMSL72J7MMVMPA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:54.018245753 (26h3m48.449325884s) [noise=true , address=104.36.82.34:4548 , piece_id=L5JDQNAKIE5R4BKFVDO2NGLLLB4EK4JG6K7RZGNCRAMH5JJTX3RA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: <nil>
Aug 9 19:29:54.018271312 (26h3m48.449351443s) [seg_pos={0 0}, upload=27208]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:29:54.018422743 (26h3m48.449502874s) [noise=true , address=104.36.82.12:4176 , piece_id=TNM26LZBR5XQQAXVHQCRRNQUWRIR26TTQEJMLL4XJXHJ4HUT45AA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kGgrsNn5tv2GkcuVHHArCACwRB2qwbj3X3JmzVF4UL6dLRW1m): protocol: expected piece hash; context canceled; EOF
Aug 9 19:29:54.018582378 (26h3m48.449662509s) [noise=true , address=104.36.82.43:4835 , piece_id=O55T2IZVUZRU2PSGTOU4HISEV34J3DSV5CA3FSMNKHUPEJVB5UWQ, seg_pos={0 0}, upload=27208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y): protocol: write tcp 188.166.225.170:48730->104.36.82.43:4835: use of closed network connection; write tcp 188.166.225.170:48730->104.36.82.43:4835: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48730->104.36.82.43:4835: use of closed network connection
Aug 9 19:29:54.018625660 (26h3m48.449705792s) [noise=true , address=104.36.82.39:4757 , piece_id=LO2A77NNI47MQCZWQH6QM52LJRWMZEDBGXWKDTCUZU343I3PLBLA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18M8G3TUJ9jLNDnWMpYaQBXfBUXpD7hzf4Xt6BzasYNnsfTWxS): protocol: write tcp 188.166.225.170:57952->104.36.82.39:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:29:54.018683611 (26h3m48.449763762s) [noise=true , address=104.36.82.17:4353 , piece_id=MB7DF4CMAO4ZQFNPBIJUH3YRZKSWPDTZHMNCLIMFMQ52QO7GJCJA, seg_pos={0 0}, upload=27208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HRqnFXL5isiFtNS4hFRidH2vchEYTvTLeiA8rbYxfVfaygn8J): protocol: read tcp 188.166.225.170:55458->104.36.82.17:4353: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:29:54.018724270 (26h3m48.449804421s) [seg_pos={0 0}, upload=27208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:29:54.018804153 (26h3m48.449884284s) [upload=27208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:29:54.018808521 (26h3m48.449888642s) [upload=27208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:29:54.975161614 (26h3m49.406241745s) [upload=27208]: Done uploading segments...
Aug 9 19:29:54.975182294 (26h3m49.406262425s) [upload=27208]: Upload finished. err: <nil>
Duration: 7.458838075s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X...........X..............................X................] duration:
1.87505124s
FAIL (2025-08-09 19:29:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 19:15:59.518233402 (25h49m53.949313533s) [upload=26968]: Starting upload
Aug 9 19:15:59.518279018 (25h49m53.94935915s) [upload=26968]: Done starting upload
Aug 9 19:15:59.518329355 (25h49m53.949409476s) [upload=26968]: Uploading segments...
Aug 9 19:15:59.518363781 (25h49m53.949443912s) [upload=26968]: Got next segment. Inline: true
Aug 9 19:15:59.518368620 (25h49m53.949448741s) [upload=26968]: Waiting for error group managing segments...
Aug 9 19:15:59.518404810 (25h49m53.949484941s) [upload=26968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:15:59.518408907 (25h49m53.949489038s) [upload=26968]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 19:15:59.518411412 (25h49m53.949491533s) [upload=26968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:15:59.799639028 (25h49m54.230719159s) [upload=26968]: Done uploading segments...
Aug 9 19:15:59.799658085 (25h49m54.230738216s) [upload=26968]: Upload finished. err: <nil>
Duration: 1.87511369s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X..................X...........................] duration:
6.655342435s
FAIL (2025-08-09 19:28:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 9 19:08:15.021907495 (25h42m9.452987626s) [upload=26833]: Starting upload
Aug 9 19:08:15.021971788 (25h42m9.453051919s) [upload=26833]: Done starting upload
Aug 9 19:08:15.022011644 (25h42m9.453091775s) [upload=26833]: Uploading segments...
Aug 9 19:08:15.022276932 (25h42m9.453357083s) [upload=26833]: Got next segment. Inline: false
Aug 9 19:08:15.022313361 (25h42m9.453393523s) [upload=26833]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:08:15.022319263 (25h42m9.453399394s) [upload=26833]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:08:15.566745690 (25h42m9.997825861s) [seg_pos={0 0}, upload=26833]: Begin upload segment...
Aug 9 19:08:15.566804712 (25h42m9.997884843s) [seg_pos={0 0}, upload=26833]: Done begin upload segment.
Aug 9 19:08:15.566823368 (25h42m9.997903509s) [noise=true , address=79.127.201.214:4322 , piece_id=UGYY5UXB6VOKDAHKABUVVZD4P3VDKFPOJRBEPMGYLICFJ4GCEWCQ, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.566858625 (25h42m9.997938757s) [noise=true , address=104.36.82.14:4238 , piece_id=EENHFUOV7GE6V2BGLKF73A7ZWKIOLFGINSVF64XUNBPHO2VGI3BA, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.567469504 (25h42m9.998549635s) [noise=true , address=104.36.82.9:4032 , piece_id=2IF6DIQK4VEQ6QOZ3R6NT5SXAJD7TQWXSBJ37QP5KE7IZBKTQBBQ, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.567561190 (25h42m9.998641321s) [noise=true , address=104.36.82.6:4906 , piece_id=SKYD7LE2UZYBCURRKV46FZ677F74B4EGRWUB4GKDH4NBSB6ZUO3A, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.567979851 (25h42m9.999059982s) [noise=true , address=104.36.82.47:4547 , piece_id=U7FDTDAMC4DTWMS56NPMEUUPQUHXF64UYD66HPAIKA7AKVQ6C27Q, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.568171628 (25h42m9.999251769s) [noise=true , address=64.49.13.26:4955 , piece_id=UUSY4QGQIW52DUCOA3CQKW2Y2SZOZOD4FIR5HPQ2JK6N5TLO25GQ, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.568483815 (25h42m9.999563946s) [noise=true , address=104.36.82.19:4419 , piece_id=TAPABPODRGMQ2I6UNDDNVPFW7NKO2FON6IABVXYO6YHVQLFEL74Q, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.568514243 (25h42m9.999594374s) [noise=true , address=104.36.82.21:4497 , piece_id=PMLN24GYCOT5ESACVLOPT5UQOEB7LZ25FFDCSBQIMVTZPLCYCODA, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.568918016 (25h42m9.999998167s) [noise=true , address=104.36.82.61:4407 , piece_id=SF47ELZOSP5ON6D3TGNX72BXR6LVTCBDZDBMXXWCV5KEBBPUW7FA, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.569293955 (25h42m10.000374086s) [noise=true , address=104.36.82.35:4608 , piece_id=EFYLSJNABBL6TLLZ5M6KFOABQQ23HPBJDYKWPV66K7UHEBMD5JCQ, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.569599059 (25h42m10.00067919s) [noise=true , address=79.127.220.98:4404 , piece_id=W77ER3JAFXBUOAH7M2IS5FVJLLTKBQ2EF3CFJYALL5MSLBOTD43Q, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.569633645 (25h42m10.000713776s) [noise=true , address=104.36.82.37:4677 , piece_id=NK3M4FBLAPVGTJYUWWSIZ46VQAROOPJA7M6DU5YBKIXOPSPMLYUA, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.570084187 (25h42m10.001164328s) [noise=true , address=104.36.82.23:4472 , piece_id=4VQQQZQVCL6YA5NUO7DBIXK64MTYE7RUSTLD7RVCU2UNOA3QNLTA, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.570410120 (25h42m10.001490251s) [noise=true , address=104.36.82.39:4751 , piece_id=TRFJQQZRCZSVJGM2642PDI4ZFK25HJJVEF5ZPAGODDWVG4NDHABQ, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.570694465 (25h42m10.001774606s) [noise=true , address=77.90.31.21:4888 , piece_id=I72BJCIW6RKUZJWFLI6GWRTZLWVU5D7FRVQDG2UOTTO5KQWDVYHQ, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.570974000 (25h42m10.002054131s) [noise=true , address=104.36.82.53:4150 , piece_id=54KXIU67HXQMSYRMPLEQXTBB7ESEOIHZNGZW6O6VX5F5Z64ZRDVQ, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.571253394 (25h42m10.002333525s) [noise=true , address=104.36.82.16:4304 , piece_id=JYDBLFAYRGFE4E3NBYPDMPCAOTBYWYC6DWKGME2PKW7K7JJKUWOA, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:15.571526777 (25h42m10.002606908s) [noise=true , address=104.36.82.35:4605 , piece_id=IUNMBHIY6XHEOZCSBSSG2JWOLM66UDRDFZWKRXVNFJZSO6XDXZGA, seg_pos={0 0}, upload=26833]: Uploading piece...
Aug 9 19:08:16.670205261 (25h42m11.101285392s) [upload=26833]: Next returned nil segment
Aug 9 19:08:16.670224639 (25h42m11.10130477s) [upload=26833]: Waiting for error group managing segments...
Aug 9 19:08:16.981482822 (25h42m11.412562953s) [noise=true , address=64.49.13.26:4955 , piece_id=UUSY4QGQIW52DUCOA3CQKW2Y2SZOZOD4FIR5HPQ2JK6N5TLO25GQ, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:17.256884631 (25h42m11.687964762s) [noise=true , address=79.127.220.98:4404 , piece_id=W77ER3JAFXBUOAH7M2IS5FVJLLTKBQ2EF3CFJYALL5MSLBOTD43Q, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:17.459066027 (25h42m11.890146158s) [noise=true , address=79.127.201.214:4322 , piece_id=UGYY5UXB6VOKDAHKABUVVZD4P3VDKFPOJRBEPMGYLICFJ4GCEWCQ, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:17.533336018 (25h42m11.96441615s) [noise=true , address=104.36.82.53:4150 , piece_id=54KXIU67HXQMSYRMPLEQXTBB7ESEOIHZNGZW6O6VX5F5Z64ZRDVQ, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:17.539267708 (25h42m11.970347829s) [noise=true , address=104.36.82.21:4497 , piece_id=PMLN24GYCOT5ESACVLOPT5UQOEB7LZ25FFDCSBQIMVTZPLCYCODA, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:17.555902696 (25h42m11.986982857s) [noise=true , address=104.36.82.35:4605 , piece_id=IUNMBHIY6XHEOZCSBSSG2JWOLM66UDRDFZWKRXVNFJZSO6XDXZGA, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:17.578611134 (25h42m12.009691255s) [noise=true , address=104.36.82.23:4472 , piece_id=4VQQQZQVCL6YA5NUO7DBIXK64MTYE7RUSTLD7RVCU2UNOA3QNLTA, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:17.586885074 (25h42m12.017965205s) [noise=true , address=104.36.82.16:4304 , piece_id=JYDBLFAYRGFE4E3NBYPDMPCAOTBYWYC6DWKGME2PKW7K7JJKUWOA, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:17.605846574 (25h42m12.036926705s) [noise=true , address=104.36.82.35:4608 , piece_id=EFYLSJNABBL6TLLZ5M6KFOABQQ23HPBJDYKWPV66K7UHEBMD5JCQ, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:17.649042662 (25h42m12.080122793s) [noise=true , address=77.90.31.21:4888 , piece_id=I72BJCIW6RKUZJWFLI6GWRTZLWVU5D7FRVQDG2UOTTO5KQWDVYHQ, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:17.873860218 (25h42m12.304940339s) [noise=true , address=104.36.82.9:4032 , piece_id=2IF6DIQK4VEQ6QOZ3R6NT5SXAJD7TQWXSBJ37QP5KE7IZBKTQBBQ, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:18.796203257 (25h42m13.227283389s) [noise=true , address=104.36.82.37:4677 , piece_id=NK3M4FBLAPVGTJYUWWSIZ46VQAROOPJA7M6DU5YBKIXOPSPMLYUA, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:18.891353128 (25h42m13.322433259s) [noise=true , address=104.36.82.14:4238 , piece_id=EENHFUOV7GE6V2BGLKF73A7ZWKIOLFGINSVF64XUNBPHO2VGI3BA, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:19.521728020 (25h42m13.952808151s) [noise=true , address=104.36.82.6:4906 , piece_id=SKYD7LE2UZYBCURRKV46FZ677F74B4EGRWUB4GKDH4NBSB6ZUO3A, seg_pos={0 0}, upload=26833]: Done uploading piece. err: <nil>
Aug 9 19:08:19.521749601 (25h42m13.952829732s) [seg_pos={0 0}, upload=26833]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:08:19.521840555 (25h42m13.952920686s) [noise=true , address=104.36.82.19:4419 , piece_id=TAPABPODRGMQ2I6UNDDNVPFW7NKO2FON6IABVXYO6YHVQLFEL74Q, seg_pos={0 0}, upload=26833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 9 19:08:19.522033213 (25h42m13.953113345s) [noise=true , address=104.36.82.61:4407 , piece_id=SF47ELZOSP5ON6D3TGNX72BXR6LVTCBDZDBMXXWCV5KEBBPUW7FA, seg_pos={0 0}, upload=26833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122k7b6wa2JhSXMVAhF4qPKA48cWkh3DZRyWuwPEt7Vp3ciofPF): protocol: rpc: dial tcp 104.36.82.61:4407: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:08:19.522056779 (25h42m13.95313691s) [noise=true , address=104.36.82.47:4547 , piece_id=U7FDTDAMC4DTWMS56NPMEUUPQUHXF64UYD66HPAIKA7AKVQ6C27Q, seg_pos={0 0}, upload=26833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12brQg9WQMKJgp1buz1wMS8W11XEwAx7RHG5h51EmLvwY5D5Hky): protocol: rpc: dial tcp 104.36.82.47:4547: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:08:19.522109019 (25h42m13.95318915s) [noise=true , address=104.36.82.39:4751 , piece_id=TRFJQQZRCZSVJGM2642PDI4ZFK25HJJVEF5ZPAGODDWVG4NDHABQ, seg_pos={0 0}, upload=26833]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128StmvpG1KYRXeu3gzEEfRmYZgR5ACJRf2xGZcEiZHsfk1KNyr): protocol: read tcp 188.166.225.170:41656->104.36.82.39:4751: use of closed network connection; context canceled
Aug 9 19:08:19.522118426 (25h42m13.953198557s) [seg_pos={0 0}, upload=26833]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:08:19.522171789 (25h42m13.95325192s) [upload=26833]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:08:19.522175205 (25h42m13.953255336s) [upload=26833]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:08:19.826788285 (25h42m14.257868416s) [upload=26833]: Done uploading segments...
Aug 9 19:08:19.826804015 (25h42m14.257884146s) [upload=26833]: Upload finished. err: <nil>
Duration: 6.655368215s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X...........X..............................X...............] duration:
1.882525719s
FAIL (2025-08-09 19:28:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 19:15:59.518233402 (25h49m53.949313533s) [upload=26968]: Starting upload
Aug 9 19:15:59.518279018 (25h49m53.94935915s) [upload=26968]: Done starting upload
Aug 9 19:15:59.518329355 (25h49m53.949409476s) [upload=26968]: Uploading segments...
Aug 9 19:15:59.518363781 (25h49m53.949443912s) [upload=26968]: Got next segment. Inline: true
Aug 9 19:15:59.518368620 (25h49m53.949448741s) [upload=26968]: Waiting for error group managing segments...
Aug 9 19:15:59.518404810 (25h49m53.949484941s) [upload=26968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:15:59.518408907 (25h49m53.949489038s) [upload=26968]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 19:15:59.518411412 (25h49m53.949491533s) [upload=26968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:15:59.799639028 (25h49m54.230719159s) [upload=26968]: Done uploading segments...
Aug 9 19:15:59.799658085 (25h49m54.230738216s) [upload=26968]: Upload finished. err: <nil>
Duration: 1.882551778s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|