Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X.X.......................................X.X..X...] duration:
2.270600358s
FAIL (2025-08-09 20:07:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 9 20:05:31.654790058 (26h39m26.085870189s) [upload=27823]: Starting upload Aug 9 20:05:31.654831007 (26h39m26.085911138s) [upload=27823]: Done starting upload Aug 9 20:05:31.654872226 (26h39m26.085952347s) [upload=27823]: Uploading segments... Aug 9 20:05:31.654948011 (26h39m26.086028142s) [upload=27823]: Got next segment. Inline: true Aug 9 20:05:31.654952539 (26h39m26.08603268s) [upload=27823]: Waiting for error group managing segments... Aug 9 20:05:31.655045777 (26h39m26.086125908s) [upload=27823]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 20:05:31.655049976 (26h39m26.086130107s) [upload=27823]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 20:05:31.655052711 (26h39m26.086132842s) [upload=27823]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 20:05:31.967319759 (26h39m26.39839989s) [upload=27823]: Done uploading segments... Aug 9 20:05:31.967338564 (26h39m26.398418696s) [upload=27823]: Upload finished. err: <nil>
Duration: 2.2706282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.X.........X....................................] duration:
5.858884035s
FAIL (2025-08-09 20:07:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 5.858903681s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X.X.......................................X.X..X..] duration:
1.963925951s
FAIL (2025-08-09 20:07:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 9 20:05:31.654790058 (26h39m26.085870189s) [upload=27823]: Starting upload Aug 9 20:05:31.654831007 (26h39m26.085911138s) [upload=27823]: Done starting upload Aug 9 20:05:31.654872226 (26h39m26.085952347s) [upload=27823]: Uploading segments... Aug 9 20:05:31.654948011 (26h39m26.086028142s) [upload=27823]: Got next segment. Inline: true Aug 9 20:05:31.654952539 (26h39m26.08603268s) [upload=27823]: Waiting for error group managing segments... Aug 9 20:05:31.655045777 (26h39m26.086125908s) [upload=27823]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 20:05:31.655049976 (26h39m26.086130107s) [upload=27823]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 20:05:31.655052711 (26h39m26.086132842s) [upload=27823]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 20:05:31.967319759 (26h39m26.39839989s) [upload=27823]: Done uploading segments... Aug 9 20:05:31.967338564 (26h39m26.398418696s) [upload=27823]: Upload finished. err: <nil>
Duration: 1.963946812s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X.X.......................................X.X..X.] duration:
2.238054648s
FAIL (2025-08-09 20:06:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 9 20:05:31.654790058 (26h39m26.085870189s) [upload=27823]: Starting upload Aug 9 20:05:31.654831007 (26h39m26.085911138s) [upload=27823]: Done starting upload Aug 9 20:05:31.654872226 (26h39m26.085952347s) [upload=27823]: Uploading segments... Aug 9 20:05:31.654948011 (26h39m26.086028142s) [upload=27823]: Got next segment. Inline: true Aug 9 20:05:31.654952539 (26h39m26.08603268s) [upload=27823]: Waiting for error group managing segments... Aug 9 20:05:31.655045777 (26h39m26.086125908s) [upload=27823]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 20:05:31.655049976 (26h39m26.086130107s) [upload=27823]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 20:05:31.655052711 (26h39m26.086132842s) [upload=27823]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 20:05:31.967319759 (26h39m26.39839989s) [upload=27823]: Done uploading segments... Aug 9 20:05:31.967338564 (26h39m26.398418696s) [upload=27823]: Upload finished. err: <nil>
Duration: 2.238083813s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.X.........X...................................] duration:
7.437711941s
FAIL (2025-08-09 20:06:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 7.437738512s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.X.........X..................................] duration:
10.147793093s
FAIL (2025-08-09 20:05:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 10.147821518s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X.X.......................................X.X..X] duration:
1.676672398s
FAIL (2025-08-09 20:05:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 9 20:05:31.654790058 (26h39m26.085870189s) [upload=27823]: Starting upload Aug 9 20:05:31.654831007 (26h39m26.085911138s) [upload=27823]: Done starting upload Aug 9 20:05:31.654872226 (26h39m26.085952347s) [upload=27823]: Uploading segments... Aug 9 20:05:31.654948011 (26h39m26.086028142s) [upload=27823]: Got next segment. Inline: true Aug 9 20:05:31.654952539 (26h39m26.08603268s) [upload=27823]: Waiting for error group managing segments... Aug 9 20:05:31.655045777 (26h39m26.086125908s) [upload=27823]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 20:05:31.655049976 (26h39m26.086130107s) [upload=27823]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 20:05:31.655052711 (26h39m26.086132842s) [upload=27823]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 20:05:31.967319759 (26h39m26.39839989s) [upload=27823]: Done uploading segments... Aug 9 20:05:31.967338564 (26h39m26.398418696s) [upload=27823]: Upload finished. err: <nil>
Duration: 1.676712094s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.X.......................................X.X..] duration:
1.943676923s
FAIL (2025-08-09 20:05:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 20:03:39.283549814 (26h37m33.714629945s) [upload=27790]: Starting upload Aug 9 20:03:39.283609638 (26h37m33.714689769s) [upload=27790]: Done starting upload Aug 9 20:03:39.283662991 (26h37m33.714743122s) [upload=27790]: Uploading segments... Aug 9 20:03:39.283708338 (26h37m33.714788459s) [upload=27790]: Got next segment. Inline: true Aug 9 20:03:39.283713117 (26h37m33.714793248s) [upload=27790]: Waiting for error group managing segments... Aug 9 20:03:39.283747953 (26h37m33.714828084s) [upload=27790]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 20:03:39.283752081 (26h37m33.714832202s) [upload=27790]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 20:03:39.283755477 (26h37m33.714835608s) [upload=27790]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 20:03:39.635184493 (26h37m34.066264624s) [upload=27790]: Done uploading segments... Aug 9 20:03:39.635202508 (26h37m34.066282639s) [upload=27790]: Upload finished. err: <nil>
Duration: 1.943704466s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.X.........X.................................] duration:
7.341178549s
FAIL (2025-08-09 20:04:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 7.34120508s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.X.......................................X.X.] duration:
1.945884337s
FAIL (2025-08-09 20:04:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 20:03:39.283549814 (26h37m33.714629945s) [upload=27790]: Starting upload Aug 9 20:03:39.283609638 (26h37m33.714689769s) [upload=27790]: Done starting upload Aug 9 20:03:39.283662991 (26h37m33.714743122s) [upload=27790]: Uploading segments... Aug 9 20:03:39.283708338 (26h37m33.714788459s) [upload=27790]: Got next segment. Inline: true Aug 9 20:03:39.283713117 (26h37m33.714793248s) [upload=27790]: Waiting for error group managing segments... Aug 9 20:03:39.283747953 (26h37m33.714828084s) [upload=27790]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 20:03:39.283752081 (26h37m33.714832202s) [upload=27790]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 20:03:39.283755477 (26h37m33.714835608s) [upload=27790]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 20:03:39.635184493 (26h37m34.066264624s) [upload=27790]: Done uploading segments... Aug 9 20:03:39.635202508 (26h37m34.066282639s) [upload=27790]: Upload finished. err: <nil>
Duration: 1.945923972s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X.X.......................................X.X] duration:
1.450953093s
FAIL (2025-08-09 20:03:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 20:03:39.283549814 (26h37m33.714629945s) [upload=27790]: Starting upload Aug 9 20:03:39.283609638 (26h37m33.714689769s) [upload=27790]: Done starting upload Aug 9 20:03:39.283662991 (26h37m33.714743122s) [upload=27790]: Uploading segments... Aug 9 20:03:39.283708338 (26h37m33.714788459s) [upload=27790]: Got next segment. Inline: true Aug 9 20:03:39.283713117 (26h37m33.714793248s) [upload=27790]: Waiting for error group managing segments... Aug 9 20:03:39.283747953 (26h37m33.714828084s) [upload=27790]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 20:03:39.283752081 (26h37m33.714832202s) [upload=27790]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 20:03:39.283755477 (26h37m33.714835608s) [upload=27790]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 20:03:39.635184493 (26h37m34.066264624s) [upload=27790]: Done uploading segments... Aug 9 20:03:39.635202508 (26h37m34.066282639s) [upload=27790]: Upload finished. err: <nil>
Duration: 1.450980285s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.X.........X................................] duration:
6.804669942s
FAIL (2025-08-09 20:03:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.804698655s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.X.......................................X.] duration:
1.967617903s
FAIL (2025-08-09 20:03:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 20:01:46.793516766 (26h35m41.224596897s) [upload=27761]: Starting upload
Aug 9 20:01:46.793567262 (26h35m41.224647383s) [upload=27761]: Done starting upload
Aug 9 20:01:46.793646163 (26h35m41.224726294s) [upload=27761]: Uploading segments...
Aug 9 20:01:46.793734583 (26h35m41.224814714s) [upload=27761]: Got next segment. Inline: true
Aug 9 20:01:46.793741055 (26h35m41.224821186s) [upload=27761]: Waiting for error group managing segments...
Aug 9 20:01:46.793781832 (26h35m41.224861964s) [upload=27761]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 20:01:46.793786792 (26h35m41.224866923s) [upload=27761]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 20:01:46.793789177 (26h35m41.224869308s) [upload=27761]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 20:01:47.075004352 (26h35m41.506084483s) [upload=27761]: Done uploading segments...
Aug 9 20:01:47.075035070 (26h35m41.506115202s) [upload=27761]: Upload finished. err: <nil>
Duration: 1.967644354s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.X.........X...............................] duration:
6.059291186s
FAIL (2025-08-09 20:02:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.059318088s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.X.........X..............................] duration:
7.03069815s
FAIL (2025-08-09 20:01:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 7.030727878s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.X.......................................X] duration:
1.623334134s
FAIL (2025-08-09 20:01:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 20:01:46.793516766 (26h35m41.224596897s) [upload=27761]: Starting upload
Aug 9 20:01:46.793567262 (26h35m41.224647383s) [upload=27761]: Done starting upload
Aug 9 20:01:46.793646163 (26h35m41.224726294s) [upload=27761]: Uploading segments...
Aug 9 20:01:46.793734583 (26h35m41.224814714s) [upload=27761]: Got next segment. Inline: true
Aug 9 20:01:46.793741055 (26h35m41.224821186s) [upload=27761]: Waiting for error group managing segments...
Aug 9 20:01:46.793781832 (26h35m41.224861964s) [upload=27761]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 20:01:46.793786792 (26h35m41.224866923s) [upload=27761]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 20:01:46.793789177 (26h35m41.224869308s) [upload=27761]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 20:01:47.075004352 (26h35m41.506084483s) [upload=27761]: Done uploading segments...
Aug 9 20:01:47.075035070 (26h35m41.506115202s) [upload=27761]: Upload finished. err: <nil>
Duration: 1.623354282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.................X.X.......................................] duration:
1.853883958s
FAIL (2025-08-09 20:00:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.853909158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X.X.........X.............................] duration:
7.648993016s
FAIL (2025-08-09 20:00:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 7.649017543s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X.X.........X............................] duration:
6.527809418s
FAIL (2025-08-09 20:00:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.527835579s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.................X.X......................................] duration:
2.218815271s
FAIL (2025-08-09 20:00:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.218849337s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.................X.X.....................................] duration:
2.089048115s
FAIL (2025-08-09 20:00:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.089073535s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X.X.........X...........................] duration:
6.705401077s
FAIL (2025-08-09 19:59:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.705430202s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.................X.X....................................] duration:
2.25886666s
FAIL (2025-08-09 19:58:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.258893082s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.X.........X..........................] duration:
6.313556193s
FAIL (2025-08-09 19:58:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.313580599s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X.X.........X.........................] duration:
6.381077917s
FAIL (2025-08-09 19:58:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.381097143s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.................X.X...................................] duration:
1.8228757s
FAIL (2025-08-09 19:57:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.822899204s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.X.........X........................] duration:
6.347939721s
FAIL (2025-08-09 19:57:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.347959788s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.................X.X..................................] duration:
2.125003958s
FAIL (2025-08-09 19:57:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.125027784s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.................X.X.................................] duration:
1.86547114s
FAIL (2025-08-09 19:57:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.86549741s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X.X.........X.......................] duration:
6.747184423s
FAIL (2025-08-09 19:56:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.747212648s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.X.........X......................] duration:
6.724871712s
FAIL (2025-08-09 19:55:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.724895597s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.................X.X................................] duration:
2.207160586s
FAIL (2025-08-09 19:55:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.207194721s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X.X.........X.....................] duration:
9.508096743s
FAIL (2025-08-09 19:55:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 9.508127121s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.................X.X...............................] duration:
1.915892973s
FAIL (2025-08-09 19:55:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.915917109s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.................X.X..............................] duration:
2.149095115s
FAIL (2025-08-09 19:55:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.1491297s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X.X.........X....................] duration:
8.350293289s
FAIL (2025-08-09 19:54:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 8.350312645s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X...........................X.X.........X...................] duration:
8.149287068s
FAIL (2025-08-09 19:54:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 8.149310933s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X...........................X.X.........X..................] duration:
6.857731842s
FAIL (2025-08-09 19:53:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.857755458s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.................X.X.............................] duration:
2.025241209s
FAIL (2025-08-09 19:53:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.02526763s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X...........................X.X.........X.................] duration:
9.709271782s
FAIL (2025-08-09 19:53:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 9.70931765s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X...........................X.X.........X................] duration:
6.584525666s
FAIL (2025-08-09 19:53:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.584553961s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.................X.X............................] duration:
1.924121307s
FAIL (2025-08-09 19:53:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.924146185s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.................X.X...........................] duration:
1.939523166s
FAIL (2025-08-09 19:52:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.939544867s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.................X.X..........................] duration:
1.931076574s
FAIL (2025-08-09 19:52:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.931108074s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X...........................X.X.........X...............] duration:
7.280030873s
FAIL (2025-08-09 19:52:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 7.280060449s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.................X.X.........................] duration:
1.873346378s
FAIL (2025-08-09 19:51:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.873369202s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.................X.X........................] duration:
1.989626258s
FAIL (2025-08-09 19:50:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.989694038s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X...........................X.X.........X..............] duration:
6.327875205s
FAIL (2025-08-09 19:50:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 37898ab98e22dfc5f89b58038d01b45f4a161df3ac29806141f120b386ba8ac6 != before 1fb1b63f78cdcc733117ecbb679373b218a8bda2ce4eb6059a657e539a365b9b
======LOGS======
Aug 9 19:38:57.915501089 (26h12m52.34658122s) [upload=27371]: Starting upload
Aug 9 19:38:57.915569921 (26h12m52.346650052s) [upload=27371]: Done starting upload
Aug 9 19:38:57.915692305 (26h12m52.346772436s) [upload=27371]: Uploading segments...
Aug 9 19:38:57.915790603 (26h12m52.346870735s) [upload=27371]: Got next segment. Inline: false
Aug 9 19:38:57.915831451 (26h12m52.346911572s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 19:38:57.915836101 (26h12m52.346916222s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 19:38:58.368319093 (26h12m52.799399214s) [seg_pos={0 0}, upload=27371]: Begin upload segment...
Aug 9 19:38:58.368358949 (26h12m52.79943908s) [seg_pos={0 0}, upload=27371]: Done begin upload segment.
Aug 9 19:38:58.368380420 (26h12m52.799460552s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368398485 (26h12m52.799478616s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368700293 (26h12m52.799780424s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368734308 (26h12m52.799814439s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.368961432 (26h12m52.800041563s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369037648 (26h12m52.800117779s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369207272 (26h12m52.800287403s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369332142 (26h12m52.800412273s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369442373 (26h12m52.800522494s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369576969 (26h12m52.80065709s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369656001 (26h12m52.800736122s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369846285 (26h12m52.800926406s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.369888115 (26h12m52.800968246s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370100040 (26h12m52.801180171s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370106583 (26h12m52.801186714s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370313940 (26h12m52.801394061s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370365488 (26h12m52.801445619s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:58.370500667 (26h12m52.801580788s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Uploading piece...
Aug 9 19:38:59.464886943 (26h12m53.895967074s) [upload=27371]: Next returned nil segment
Aug 9 19:38:59.464907862 (26h12m53.895987993s) [upload=27371]: Waiting for error group managing segments...
Aug 9 19:38:59.793132651 (26h12m54.224212782s) [noise=true , address=79.127.205.233:4625 , piece_id=WCOXGDHVNA2FIADKNTPPC3UVSCHMTIK4MEX544PYPVRN6QD3VDKA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.807816605 (26h12m54.238896736s) [noise=true , address=64.49.13.26:4948 , piece_id=VQU3274IDMUJXGPJUBWANFQYO7AQ56LL4WXQFRLSQDGPUMPOJFZA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:38:59.823575478 (26h12m54.254655649s) [noise=true , address=64.49.13.139:4469 , piece_id=RQVTAFPSRC6YZXVE24536W5SRSIBPOMKIPL64CUGX3EZAOROWNFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.313719367 (26h12m54.744799498s) [noise=true , address=104.36.82.61:4394 , piece_id=WMNKGBKNCOAGEGJBOUYPNMIDGH6W6QORS5PY7WX3FG3MVSOFLBNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.331192288 (26h12m54.76227242s) [noise=true , address=104.36.82.34:4559 , piece_id=E4KUM5B2XOWBZBPEPMHUTREZY2B2QAVC4FVHPHKPLFVMCVJGHLOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.382278151 (26h12m54.813358282s) [noise=true , address=104.36.82.55:4194 , piece_id=ONOB3Y55K4INITXLBGRDSOJNFHIBA5HAPCXOYRXMVYM5TIU7IPDQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.386159939 (26h12m54.81724007s) [noise=true , address=104.36.82.16:4308 , piece_id=WW6JZVN5HKWTDAJ5LDAZ24SAISEAURTXA5HCQKCVTJJFITOKIZ4A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.388833584 (26h12m54.819913715s) [noise=true , address=104.36.82.61:4403 , piece_id=LAWVR3E7MJIXEGBV3OHNTMRZF6HRKCCZY674IYHRIVKPTZYUCTNQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.406136100 (26h12m54.837216231s) [noise=true , address=104.36.82.9:4024 , piece_id=M3NZCYLADAMCAV5YOGRBAUDC3RGGKSJHLIBSRO34CGHZVLUGKTFQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.454717511 (26h12m54.885797642s) [noise=true , address=104.36.82.18:4372 , piece_id=VWAWRJQCU2FDVLRPDV4KCWJLV3YV6CZ5WAH45SHBE3SJTV3B2KPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.470336685 (26h12m54.901416816s) [noise=true , address=104.36.82.14:4227 , piece_id=7646FYXESZETO7I3VWFS3OOGRFJVMOTIXNCU776E6NVKHVTOEHAQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.586538185 (26h12m55.017618326s) [noise=true , address=104.36.82.47:4540 , piece_id=F3DGO4UPA4ZGTFTV3ONF73O73QJDFC2HYOZ3XSJTCSYQ5US3OBUA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.593071516 (26h12m55.024151647s) [noise=true , address=45.91.116.4:4948 , piece_id=AYS6VXRFNK7ICDKKN273ONROBJL4RB3G6OGXAUK7QGYWUFQQKPPA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812647895 (26h12m55.243728026s) [noise=true , address=104.36.82.5:4852 , piece_id=YZRAF3JBA65Q4NAS5SIMB7JEALDBLJ3HUTEWY5ECPZJDOZGF7IWQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: <nil>
Aug 9 19:39:00.812675588 (26h12m55.243755719s) [seg_pos={0 0}, upload=27371]: Segment reached optimal threshold of 14 pieces.
Aug 9 19:39:00.812868146 (26h12m55.243948277s) [noise=true , address=104.36.82.45:4939 , piece_id=UKXLDL7NEMQUCAOF7NQACWHOJMTDTQSF27NX6PAYCFCJ26X7ZWVA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu): protocol: context canceled; context canceled
Aug 9 19:39:00.813106412 (26h12m55.244186543s) [noise=true , address=104.36.82.6:4892 , piece_id=RWS4YT4G6Z6GPRJ3Z3LSM2455X5U7B3HATISBFPM6IDCTIW62JOQ, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA): protocol: rpc: dial tcp 104.36.82.6:4892: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813119156 (26h12m55.244199287s) [noise=true , address=104.36.82.62:4421 , piece_id=2DWMAFYGSMEZFKECJE6OJS3JL2I3MX7RWHE63EOYA64M6UL3WC2A, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NEpwAXnTuoC8qPDdDEeRki845XdWxYw2YW46XoFPXhn3BQwxD): protocol: rpc: dial tcp 104.36.82.62:4421: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813144174 (26h12m55.244224295s) [noise=true , address=104.36.82.23:4476 , piece_id=UEBSL5WOSD7KUU6FK2MQNELJOBCBPWZYHAWXRS44EOMKNGSCTJGA, seg_pos={0 0}, upload=27371]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: read tcp 188.166.225.170:39248->104.36.82.23:4476: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 9 19:39:00.813162670 (26h12m55.244242801s) [seg_pos={0 0}, upload=27371]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 19:39:00.813228545 (26h12m55.244308666s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 19:39:00.813232102 (26h12m55.244312223s) [upload=27371]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 19:39:01.136406027 (26h12m55.567486158s) [upload=27371]: Done uploading segments...
Aug 9 19:39:01.136429893 (26h12m55.567510064s) [upload=27371]: Upload finished. err: <nil>
Duration: 6.3278986s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.................X.X.......................] duration:
1.929087948s
FAIL (2025-08-09 19:50:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.929110674s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.................X.X......................] duration:
1.957126205s
FAIL (2025-08-09 19:49:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 19:32:44.193156676 (26h6m38.624236807s) [upload=27261]: Starting upload Aug 9 19:32:44.193213976 (26h6m38.624294107s) [upload=27261]: Done starting upload Aug 9 19:32:44.193265394 (26h6m38.624345525s) [upload=27261]: Uploading segments... Aug 9 19:32:44.193303417 (26h6m38.624383548s) [upload=27261]: Got next segment. Inline: true Aug 9 19:32:44.193307144 (26h6m38.624387275s) [upload=27261]: Waiting for error group managing segments... Aug 9 19:32:44.193342542 (26h6m38.624422673s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 19:32:44.193346860 (26h6m38.624426991s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 19:32:44.193349425 (26h6m38.624429546s) [upload=27261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 19:32:44.408445041 (26h6m38.839525172s) [upload=27261]: Done uploading segments... Aug 9 19:32:44.408463475 (26h6m38.839543606s) [upload=27261]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.957146113s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|