Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X........X.....................X................] duration:
1.813298886s
FAIL (2025-08-19 05:55:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.813339594s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..........................XX......................X.......] duration:
5.656706815s
FAIL (2025-08-19 05:54:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 05:49:29.232861933 (252h23m23.663942064s) [upload=262480]: Starting upload
Aug 19 05:49:29.232927279 (252h23m23.66400744s) [upload=262480]: Done starting upload
Aug 19 05:49:29.233025566 (252h23m23.664105687s) [upload=262480]: Uploading segments...
Aug 19 05:49:29.233442213 (252h23m23.664522364s) [upload=262480]: Got next segment. Inline: false
Aug 19 05:49:29.233491919 (252h23m23.66457205s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:49:29.233499643 (252h23m23.664579794s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:49:29.675718161 (252h23m24.106798372s) [seg_pos={0 0}, upload=262480]: Begin upload segment...
Aug 19 05:49:29.675796771 (252h23m24.106876892s) [seg_pos={0 0}, upload=262480]: Done begin upload segment.
Aug 19 05:49:29.675821228 (252h23m24.106901359s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.675893436 (252h23m24.106973557s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676390677 (252h23m24.107470808s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676503203 (252h23m24.107583334s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676758020 (252h23m24.107838152s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677047113 (252h23m24.108127244s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677062403 (252h23m24.108142534s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677309626 (252h23m24.108389757s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677368037 (252h23m24.108448158s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677593819 (252h23m24.10867395s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677702998 (252h23m24.108783129s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677874547 (252h23m24.108954678s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677971753 (252h23m24.109051874s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678131218 (252h23m24.109211339s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678192274 (252h23m24.109272406s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678380865 (252h23m24.109460996s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678405723 (252h23m24.109485854s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678628018 (252h23m24.109708159s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:30.822791813 (252h23m25.253871944s) [upload=262480]: Next returned nil segment
Aug 19 05:49:30.822807262 (252h23m25.253887393s) [upload=262480]: Waiting for error group managing segments...
Aug 19 05:49:31.117339073 (252h23m25.548419204s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.534480195 (252h23m25.965560326s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.626986707 (252h23m26.058066838s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.633831114 (252h23m26.064911235s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.639991261 (252h23m26.071084056s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.644243607 (252h23m26.075323738s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.649728071 (252h23m26.080808212s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.668239702 (252h23m26.099319833s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.741487815 (252h23m26.172567946s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.759208913 (252h23m26.190289044s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.787602101 (252h23m26.218682222s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.802081466 (252h23m26.233161597s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.852772378 (252h23m26.28385251s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856034510 (252h23m26.287114641s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856048277 (252h23m26.287128408s) [seg_pos={0 0}, upload=262480]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:49:31.856156775 (252h23m26.287236906s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856217110 (252h23m26.287297241s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856272155 (252h23m26.287352286s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856335657 (252h23m26.287415788s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856377828 (252h23m26.287457959s) [seg_pos={0 0}, upload=262480]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:49:31.856458753 (252h23m26.287538884s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:49:31.856463922 (252h23m26.287544053s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:49:32.158138239 (252h23m26.58921837s) [upload=262480]: Done uploading segments...
Aug 19 05:49:32.158162165 (252h23m26.589242296s) [upload=262480]: Upload finished. err: <nil>
Duration: 5.656729468s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..........................XX......................X......] duration:
5.690085844s
FAIL (2025-08-19 05:54:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 05:49:29.232861933 (252h23m23.663942064s) [upload=262480]: Starting upload
Aug 19 05:49:29.232927279 (252h23m23.66400744s) [upload=262480]: Done starting upload
Aug 19 05:49:29.233025566 (252h23m23.664105687s) [upload=262480]: Uploading segments...
Aug 19 05:49:29.233442213 (252h23m23.664522364s) [upload=262480]: Got next segment. Inline: false
Aug 19 05:49:29.233491919 (252h23m23.66457205s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:49:29.233499643 (252h23m23.664579794s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:49:29.675718161 (252h23m24.106798372s) [seg_pos={0 0}, upload=262480]: Begin upload segment...
Aug 19 05:49:29.675796771 (252h23m24.106876892s) [seg_pos={0 0}, upload=262480]: Done begin upload segment.
Aug 19 05:49:29.675821228 (252h23m24.106901359s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.675893436 (252h23m24.106973557s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676390677 (252h23m24.107470808s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676503203 (252h23m24.107583334s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676758020 (252h23m24.107838152s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677047113 (252h23m24.108127244s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677062403 (252h23m24.108142534s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677309626 (252h23m24.108389757s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677368037 (252h23m24.108448158s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677593819 (252h23m24.10867395s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677702998 (252h23m24.108783129s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677874547 (252h23m24.108954678s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677971753 (252h23m24.109051874s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678131218 (252h23m24.109211339s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678192274 (252h23m24.109272406s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678380865 (252h23m24.109460996s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678405723 (252h23m24.109485854s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678628018 (252h23m24.109708159s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:30.822791813 (252h23m25.253871944s) [upload=262480]: Next returned nil segment
Aug 19 05:49:30.822807262 (252h23m25.253887393s) [upload=262480]: Waiting for error group managing segments...
Aug 19 05:49:31.117339073 (252h23m25.548419204s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.534480195 (252h23m25.965560326s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.626986707 (252h23m26.058066838s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.633831114 (252h23m26.064911235s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.639991261 (252h23m26.071084056s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.644243607 (252h23m26.075323738s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.649728071 (252h23m26.080808212s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.668239702 (252h23m26.099319833s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.741487815 (252h23m26.172567946s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.759208913 (252h23m26.190289044s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.787602101 (252h23m26.218682222s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.802081466 (252h23m26.233161597s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.852772378 (252h23m26.28385251s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856034510 (252h23m26.287114641s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856048277 (252h23m26.287128408s) [seg_pos={0 0}, upload=262480]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:49:31.856156775 (252h23m26.287236906s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856217110 (252h23m26.287297241s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856272155 (252h23m26.287352286s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856335657 (252h23m26.287415788s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856377828 (252h23m26.287457959s) [seg_pos={0 0}, upload=262480]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:49:31.856458753 (252h23m26.287538884s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:49:31.856463922 (252h23m26.287544053s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:49:32.158138239 (252h23m26.58921837s) [upload=262480]: Done uploading segments...
Aug 19 05:49:32.158162165 (252h23m26.589242296s) [upload=262480]: Upload finished. err: <nil>
Duration: 5.690105532s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X........X.....................X...............] duration:
1.827198483s
FAIL (2025-08-19 05:54:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.827223439s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X..........................XX......................X.....] duration:
6.131006777s
FAIL (2025-08-19 05:53:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 05:49:29.232861933 (252h23m23.663942064s) [upload=262480]: Starting upload
Aug 19 05:49:29.232927279 (252h23m23.66400744s) [upload=262480]: Done starting upload
Aug 19 05:49:29.233025566 (252h23m23.664105687s) [upload=262480]: Uploading segments...
Aug 19 05:49:29.233442213 (252h23m23.664522364s) [upload=262480]: Got next segment. Inline: false
Aug 19 05:49:29.233491919 (252h23m23.66457205s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:49:29.233499643 (252h23m23.664579794s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:49:29.675718161 (252h23m24.106798372s) [seg_pos={0 0}, upload=262480]: Begin upload segment...
Aug 19 05:49:29.675796771 (252h23m24.106876892s) [seg_pos={0 0}, upload=262480]: Done begin upload segment.
Aug 19 05:49:29.675821228 (252h23m24.106901359s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.675893436 (252h23m24.106973557s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676390677 (252h23m24.107470808s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676503203 (252h23m24.107583334s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676758020 (252h23m24.107838152s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677047113 (252h23m24.108127244s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677062403 (252h23m24.108142534s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677309626 (252h23m24.108389757s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677368037 (252h23m24.108448158s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677593819 (252h23m24.10867395s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677702998 (252h23m24.108783129s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677874547 (252h23m24.108954678s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677971753 (252h23m24.109051874s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678131218 (252h23m24.109211339s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678192274 (252h23m24.109272406s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678380865 (252h23m24.109460996s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678405723 (252h23m24.109485854s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678628018 (252h23m24.109708159s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:30.822791813 (252h23m25.253871944s) [upload=262480]: Next returned nil segment
Aug 19 05:49:30.822807262 (252h23m25.253887393s) [upload=262480]: Waiting for error group managing segments...
Aug 19 05:49:31.117339073 (252h23m25.548419204s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.534480195 (252h23m25.965560326s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.626986707 (252h23m26.058066838s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.633831114 (252h23m26.064911235s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.639991261 (252h23m26.071084056s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.644243607 (252h23m26.075323738s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.649728071 (252h23m26.080808212s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.668239702 (252h23m26.099319833s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.741487815 (252h23m26.172567946s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.759208913 (252h23m26.190289044s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.787602101 (252h23m26.218682222s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.802081466 (252h23m26.233161597s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.852772378 (252h23m26.28385251s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856034510 (252h23m26.287114641s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856048277 (252h23m26.287128408s) [seg_pos={0 0}, upload=262480]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:49:31.856156775 (252h23m26.287236906s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856217110 (252h23m26.287297241s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856272155 (252h23m26.287352286s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856335657 (252h23m26.287415788s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856377828 (252h23m26.287457959s) [seg_pos={0 0}, upload=262480]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:49:31.856458753 (252h23m26.287538884s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:49:31.856463922 (252h23m26.287544053s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:49:32.158138239 (252h23m26.58921837s) [upload=262480]: Done uploading segments...
Aug 19 05:49:32.158162165 (252h23m26.589242296s) [upload=262480]: Upload finished. err: <nil>
Duration: 6.131033257s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.............X........X.....................X..............] duration:
2.040526856s
FAIL (2025-08-19 05:53:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.040553477s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X..........................XX......................X....] duration:
5.714367746s
FAIL (2025-08-19 05:52:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 05:49:29.232861933 (252h23m23.663942064s) [upload=262480]: Starting upload
Aug 19 05:49:29.232927279 (252h23m23.66400744s) [upload=262480]: Done starting upload
Aug 19 05:49:29.233025566 (252h23m23.664105687s) [upload=262480]: Uploading segments...
Aug 19 05:49:29.233442213 (252h23m23.664522364s) [upload=262480]: Got next segment. Inline: false
Aug 19 05:49:29.233491919 (252h23m23.66457205s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:49:29.233499643 (252h23m23.664579794s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:49:29.675718161 (252h23m24.106798372s) [seg_pos={0 0}, upload=262480]: Begin upload segment...
Aug 19 05:49:29.675796771 (252h23m24.106876892s) [seg_pos={0 0}, upload=262480]: Done begin upload segment.
Aug 19 05:49:29.675821228 (252h23m24.106901359s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.675893436 (252h23m24.106973557s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676390677 (252h23m24.107470808s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676503203 (252h23m24.107583334s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676758020 (252h23m24.107838152s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677047113 (252h23m24.108127244s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677062403 (252h23m24.108142534s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677309626 (252h23m24.108389757s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677368037 (252h23m24.108448158s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677593819 (252h23m24.10867395s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677702998 (252h23m24.108783129s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677874547 (252h23m24.108954678s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677971753 (252h23m24.109051874s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678131218 (252h23m24.109211339s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678192274 (252h23m24.109272406s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678380865 (252h23m24.109460996s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678405723 (252h23m24.109485854s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678628018 (252h23m24.109708159s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:30.822791813 (252h23m25.253871944s) [upload=262480]: Next returned nil segment
Aug 19 05:49:30.822807262 (252h23m25.253887393s) [upload=262480]: Waiting for error group managing segments...
Aug 19 05:49:31.117339073 (252h23m25.548419204s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.534480195 (252h23m25.965560326s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.626986707 (252h23m26.058066838s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.633831114 (252h23m26.064911235s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.639991261 (252h23m26.071084056s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.644243607 (252h23m26.075323738s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.649728071 (252h23m26.080808212s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.668239702 (252h23m26.099319833s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.741487815 (252h23m26.172567946s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.759208913 (252h23m26.190289044s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.787602101 (252h23m26.218682222s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.802081466 (252h23m26.233161597s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.852772378 (252h23m26.28385251s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856034510 (252h23m26.287114641s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856048277 (252h23m26.287128408s) [seg_pos={0 0}, upload=262480]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:49:31.856156775 (252h23m26.287236906s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856217110 (252h23m26.287297241s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856272155 (252h23m26.287352286s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856335657 (252h23m26.287415788s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856377828 (252h23m26.287457959s) [seg_pos={0 0}, upload=262480]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:49:31.856458753 (252h23m26.287538884s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:49:31.856463922 (252h23m26.287544053s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:49:32.158138239 (252h23m26.58921837s) [upload=262480]: Done uploading segments...
Aug 19 05:49:32.158162165 (252h23m26.589242296s) [upload=262480]: Upload finished. err: <nil>
Duration: 5.714393926s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X.............X........X.....................X.............] duration:
1.79575111s
FAIL (2025-08-19 05:52:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.795778723s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X.............X........X.....................X............] duration:
1.853751108s
FAIL (2025-08-19 05:52:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.853769502s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X..........................XX......................X...] duration:
5.767261922s
FAIL (2025-08-19 05:52:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 05:49:29.232861933 (252h23m23.663942064s) [upload=262480]: Starting upload
Aug 19 05:49:29.232927279 (252h23m23.66400744s) [upload=262480]: Done starting upload
Aug 19 05:49:29.233025566 (252h23m23.664105687s) [upload=262480]: Uploading segments...
Aug 19 05:49:29.233442213 (252h23m23.664522364s) [upload=262480]: Got next segment. Inline: false
Aug 19 05:49:29.233491919 (252h23m23.66457205s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:49:29.233499643 (252h23m23.664579794s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:49:29.675718161 (252h23m24.106798372s) [seg_pos={0 0}, upload=262480]: Begin upload segment...
Aug 19 05:49:29.675796771 (252h23m24.106876892s) [seg_pos={0 0}, upload=262480]: Done begin upload segment.
Aug 19 05:49:29.675821228 (252h23m24.106901359s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.675893436 (252h23m24.106973557s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676390677 (252h23m24.107470808s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676503203 (252h23m24.107583334s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676758020 (252h23m24.107838152s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677047113 (252h23m24.108127244s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677062403 (252h23m24.108142534s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677309626 (252h23m24.108389757s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677368037 (252h23m24.108448158s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677593819 (252h23m24.10867395s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677702998 (252h23m24.108783129s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677874547 (252h23m24.108954678s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677971753 (252h23m24.109051874s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678131218 (252h23m24.109211339s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678192274 (252h23m24.109272406s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678380865 (252h23m24.109460996s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678405723 (252h23m24.109485854s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678628018 (252h23m24.109708159s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:30.822791813 (252h23m25.253871944s) [upload=262480]: Next returned nil segment
Aug 19 05:49:30.822807262 (252h23m25.253887393s) [upload=262480]: Waiting for error group managing segments...
Aug 19 05:49:31.117339073 (252h23m25.548419204s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.534480195 (252h23m25.965560326s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.626986707 (252h23m26.058066838s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.633831114 (252h23m26.064911235s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.639991261 (252h23m26.071084056s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.644243607 (252h23m26.075323738s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.649728071 (252h23m26.080808212s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.668239702 (252h23m26.099319833s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.741487815 (252h23m26.172567946s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.759208913 (252h23m26.190289044s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.787602101 (252h23m26.218682222s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.802081466 (252h23m26.233161597s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.852772378 (252h23m26.28385251s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856034510 (252h23m26.287114641s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856048277 (252h23m26.287128408s) [seg_pos={0 0}, upload=262480]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:49:31.856156775 (252h23m26.287236906s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856217110 (252h23m26.287297241s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856272155 (252h23m26.287352286s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856335657 (252h23m26.287415788s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856377828 (252h23m26.287457959s) [seg_pos={0 0}, upload=262480]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:49:31.856458753 (252h23m26.287538884s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:49:31.856463922 (252h23m26.287544053s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:49:32.158138239 (252h23m26.58921837s) [upload=262480]: Done uploading segments...
Aug 19 05:49:32.158162165 (252h23m26.589242296s) [upload=262480]: Upload finished. err: <nil>
Duration: 5.767291378s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X.............X........X.....................X...........] duration:
2.122488743s
FAIL (2025-08-19 05:51:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.122510805s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X..........................XX......................X..] duration:
5.743671786s
FAIL (2025-08-19 05:51:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 05:49:29.232861933 (252h23m23.663942064s) [upload=262480]: Starting upload
Aug 19 05:49:29.232927279 (252h23m23.66400744s) [upload=262480]: Done starting upload
Aug 19 05:49:29.233025566 (252h23m23.664105687s) [upload=262480]: Uploading segments...
Aug 19 05:49:29.233442213 (252h23m23.664522364s) [upload=262480]: Got next segment. Inline: false
Aug 19 05:49:29.233491919 (252h23m23.66457205s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:49:29.233499643 (252h23m23.664579794s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:49:29.675718161 (252h23m24.106798372s) [seg_pos={0 0}, upload=262480]: Begin upload segment...
Aug 19 05:49:29.675796771 (252h23m24.106876892s) [seg_pos={0 0}, upload=262480]: Done begin upload segment.
Aug 19 05:49:29.675821228 (252h23m24.106901359s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.675893436 (252h23m24.106973557s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676390677 (252h23m24.107470808s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676503203 (252h23m24.107583334s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676758020 (252h23m24.107838152s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677047113 (252h23m24.108127244s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677062403 (252h23m24.108142534s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677309626 (252h23m24.108389757s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677368037 (252h23m24.108448158s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677593819 (252h23m24.10867395s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677702998 (252h23m24.108783129s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677874547 (252h23m24.108954678s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677971753 (252h23m24.109051874s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678131218 (252h23m24.109211339s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678192274 (252h23m24.109272406s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678380865 (252h23m24.109460996s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678405723 (252h23m24.109485854s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678628018 (252h23m24.109708159s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:30.822791813 (252h23m25.253871944s) [upload=262480]: Next returned nil segment
Aug 19 05:49:30.822807262 (252h23m25.253887393s) [upload=262480]: Waiting for error group managing segments...
Aug 19 05:49:31.117339073 (252h23m25.548419204s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.534480195 (252h23m25.965560326s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.626986707 (252h23m26.058066838s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.633831114 (252h23m26.064911235s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.639991261 (252h23m26.071084056s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.644243607 (252h23m26.075323738s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.649728071 (252h23m26.080808212s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.668239702 (252h23m26.099319833s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.741487815 (252h23m26.172567946s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.759208913 (252h23m26.190289044s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.787602101 (252h23m26.218682222s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.802081466 (252h23m26.233161597s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.852772378 (252h23m26.28385251s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856034510 (252h23m26.287114641s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856048277 (252h23m26.287128408s) [seg_pos={0 0}, upload=262480]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:49:31.856156775 (252h23m26.287236906s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856217110 (252h23m26.287297241s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856272155 (252h23m26.287352286s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856335657 (252h23m26.287415788s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856377828 (252h23m26.287457959s) [seg_pos={0 0}, upload=262480]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:49:31.856458753 (252h23m26.287538884s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:49:31.856463922 (252h23m26.287544053s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:49:32.158138239 (252h23m26.58921837s) [upload=262480]: Done uploading segments...
Aug 19 05:49:32.158162165 (252h23m26.589242296s) [upload=262480]: Upload finished. err: <nil>
Duration: 5.743698777s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X..........................XX......................X.] duration:
5.797751462s
FAIL (2025-08-19 05:50:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 05:49:29.232861933 (252h23m23.663942064s) [upload=262480]: Starting upload
Aug 19 05:49:29.232927279 (252h23m23.66400744s) [upload=262480]: Done starting upload
Aug 19 05:49:29.233025566 (252h23m23.664105687s) [upload=262480]: Uploading segments...
Aug 19 05:49:29.233442213 (252h23m23.664522364s) [upload=262480]: Got next segment. Inline: false
Aug 19 05:49:29.233491919 (252h23m23.66457205s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:49:29.233499643 (252h23m23.664579794s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:49:29.675718161 (252h23m24.106798372s) [seg_pos={0 0}, upload=262480]: Begin upload segment...
Aug 19 05:49:29.675796771 (252h23m24.106876892s) [seg_pos={0 0}, upload=262480]: Done begin upload segment.
Aug 19 05:49:29.675821228 (252h23m24.106901359s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.675893436 (252h23m24.106973557s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676390677 (252h23m24.107470808s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676503203 (252h23m24.107583334s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676758020 (252h23m24.107838152s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677047113 (252h23m24.108127244s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677062403 (252h23m24.108142534s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677309626 (252h23m24.108389757s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677368037 (252h23m24.108448158s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677593819 (252h23m24.10867395s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677702998 (252h23m24.108783129s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677874547 (252h23m24.108954678s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677971753 (252h23m24.109051874s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678131218 (252h23m24.109211339s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678192274 (252h23m24.109272406s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678380865 (252h23m24.109460996s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678405723 (252h23m24.109485854s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678628018 (252h23m24.109708159s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:30.822791813 (252h23m25.253871944s) [upload=262480]: Next returned nil segment
Aug 19 05:49:30.822807262 (252h23m25.253887393s) [upload=262480]: Waiting for error group managing segments...
Aug 19 05:49:31.117339073 (252h23m25.548419204s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.534480195 (252h23m25.965560326s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.626986707 (252h23m26.058066838s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.633831114 (252h23m26.064911235s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.639991261 (252h23m26.071084056s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.644243607 (252h23m26.075323738s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.649728071 (252h23m26.080808212s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.668239702 (252h23m26.099319833s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.741487815 (252h23m26.172567946s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.759208913 (252h23m26.190289044s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.787602101 (252h23m26.218682222s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.802081466 (252h23m26.233161597s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.852772378 (252h23m26.28385251s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856034510 (252h23m26.287114641s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856048277 (252h23m26.287128408s) [seg_pos={0 0}, upload=262480]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:49:31.856156775 (252h23m26.287236906s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856217110 (252h23m26.287297241s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856272155 (252h23m26.287352286s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856335657 (252h23m26.287415788s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856377828 (252h23m26.287457959s) [seg_pos={0 0}, upload=262480]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:49:31.856458753 (252h23m26.287538884s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:49:31.856463922 (252h23m26.287544053s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:49:32.158138239 (252h23m26.58921837s) [upload=262480]: Done uploading segments...
Aug 19 05:49:32.158162165 (252h23m26.589242296s) [upload=262480]: Upload finished. err: <nil>
Duration: 5.797776289s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X.............X........X.....................X..........] duration:
1.807849599s
FAIL (2025-08-19 05:50:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.807880257s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X.............X........X.....................X.........] duration:
2.20526578s
FAIL (2025-08-19 05:49:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.205307771s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X..........................XX......................X] duration:
4.343327773s
FAIL (2025-08-19 05:49:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 05:49:29.232861933 (252h23m23.663942064s) [upload=262480]: Starting upload
Aug 19 05:49:29.232927279 (252h23m23.66400744s) [upload=262480]: Done starting upload
Aug 19 05:49:29.233025566 (252h23m23.664105687s) [upload=262480]: Uploading segments...
Aug 19 05:49:29.233442213 (252h23m23.664522364s) [upload=262480]: Got next segment. Inline: false
Aug 19 05:49:29.233491919 (252h23m23.66457205s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:49:29.233499643 (252h23m23.664579794s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:49:29.675718161 (252h23m24.106798372s) [seg_pos={0 0}, upload=262480]: Begin upload segment...
Aug 19 05:49:29.675796771 (252h23m24.106876892s) [seg_pos={0 0}, upload=262480]: Done begin upload segment.
Aug 19 05:49:29.675821228 (252h23m24.106901359s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.675893436 (252h23m24.106973557s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676390677 (252h23m24.107470808s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676503203 (252h23m24.107583334s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.676758020 (252h23m24.107838152s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677047113 (252h23m24.108127244s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677062403 (252h23m24.108142534s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677309626 (252h23m24.108389757s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677368037 (252h23m24.108448158s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677593819 (252h23m24.10867395s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677702998 (252h23m24.108783129s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677874547 (252h23m24.108954678s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.677971753 (252h23m24.109051874s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678131218 (252h23m24.109211339s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678192274 (252h23m24.109272406s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678380865 (252h23m24.109460996s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678405723 (252h23m24.109485854s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:29.678628018 (252h23m24.109708159s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Uploading piece...
Aug 19 05:49:30.822791813 (252h23m25.253871944s) [upload=262480]: Next returned nil segment
Aug 19 05:49:30.822807262 (252h23m25.253887393s) [upload=262480]: Waiting for error group managing segments...
Aug 19 05:49:31.117339073 (252h23m25.548419204s) [noise=true , address=79.127.205.246:4254 , piece_id=OURWQ3GBEXZCFYX7ZLVBVSFPCWRR4JDVCELULIN26LPE6OT5KCHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.534480195 (252h23m25.965560326s) [noise=true , address=79.127.220.101:4060 , piece_id=4S7WGQKN4WJSGGRSPZDEVCYWXZ5FGEIGHKP2NRFANSIVCML745QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.626986707 (252h23m26.058066838s) [noise=true , address=45.91.116.12:4234 , piece_id=5BYLRHMIRZHWRCJRPF64TPTPHC4274FEUCWFD7TYWU3EKBPFLWCA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.633831114 (252h23m26.064911235s) [noise=true , address=45.91.116.9:4282 , piece_id=Z6NISPOTXIN55R6WXL25KDDPFKHMPH3IMZ7NGDBGLF3VFTBFILGQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.639991261 (252h23m26.071084056s) [noise=true , address=45.91.116.7:4026 , piece_id=FBVSXDDOYGNVBG3XN6ILDWHQTS4YJSSMEG7VZ322NMDAQO54ZU5Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.644243607 (252h23m26.075323738s) [noise=true , address=45.91.116.5:4305 , piece_id=H7UDHGHMC3SNE44YHIL5NP65UAU262CPGPOQV2KDCDMEUORM2HSQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.649728071 (252h23m26.080808212s) [noise=true , address=45.91.116.14:4214 , piece_id=ZQF2EFEINZOWAMYLXEMITPBSAORRSUJPZL3K3RLHT4EEA5GKRCLA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.668239702 (252h23m26.099319833s) [noise=true , address=45.91.116.8:4056 , piece_id=IAG2GFK72L3RBFAMK2A3EN25RHGVKDD7CBIERV5ELJI6QWJMCZKA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.741487815 (252h23m26.172567946s) [noise=true , address=45.91.116.13:4157 , piece_id=3FJBIFLVKVERYQUYPEJTZIXBYKCRT63S2HJICIKPYQWXSIWGXX3Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.759208913 (252h23m26.190289044s) [noise=true , address=45.91.116.6:4976 , piece_id=B7QO3NETXGMECQCPCGYQCAU3WFNG5ERBDY7LQMD2GLWUXOW7VY6A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.787602101 (252h23m26.218682222s) [noise=true , address=77.90.31.18:4811 , piece_id=OKZJK5VC7ROYHOIZLLUKHCNPDGIZP7E6DZKKCHNHLCRTCV356CHA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.802081466 (252h23m26.233161597s) [noise=true , address=77.90.31.16:4754 , piece_id=C3AJ6RQUPQKYEM6VHC52VCVUTIYCFFTLUDWGZ7JRO3MXJXZTN5QQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.852772378 (252h23m26.28385251s) [noise=true , address=77.90.31.11:4565 , piece_id=H3MXUIBS43QLLABDXTPAJRTEUFSH4F4756X5OJJCMLBEESHIAWLQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856034510 (252h23m26.287114641s) [noise=true , address=104.36.82.44:4869 , piece_id=5LC3IWIT3JLLTT4SB2UPBR5M2BEHKFQTPHY7LSRQTYB2NIFYTITQ, seg_pos={0 0}, upload=262480]: Done uploading piece. err: <nil>
Aug 19 05:49:31.856048277 (252h23m26.287128408s) [seg_pos={0 0}, upload=262480]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:49:31.856156775 (252h23m26.287236906s) [noise=true , address=77.90.31.17:4789 , piece_id=LVXCURHIKKZPBENB32H54GEYZ47LWO3V47OQM45F5P5ZCGJO474Q, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856217110 (252h23m26.287297241s) [noise=true , address=104.36.82.60:4341 , piece_id=NIYULSXU4IUV4C3IIPHCIUMUXITCLVBDUKVWMFPLED3KBJYD7QFA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856272155 (252h23m26.287352286s) [noise=true , address=77.90.31.10:4536 , piece_id=W2PQGBMXTWXQ7IYCKY2ZNKGSSE3NNE4UJOI7TPDQ5TNSUMRAU56A, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856335657 (252h23m26.287415788s) [noise=true , address=104.36.82.5:4846 , piece_id=FZUAR73XX6UU4SZ45XPNMDRI2HMNOMEAMNR7XPZ7U76CF5FUL6YA, seg_pos={0 0}, upload=262480]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF
Aug 19 05:49:31.856377828 (252h23m26.287457959s) [seg_pos={0 0}, upload=262480]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:49:31.856458753 (252h23m26.287538884s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:49:31.856463922 (252h23m26.287544053s) [upload=262480]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:49:32.158138239 (252h23m26.58921837s) [upload=262480]: Done uploading segments...
Aug 19 05:49:32.158162165 (252h23m26.589242296s) [upload=262480]: Upload finished. err: <nil>
Duration: 4.343354583s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X..........................XX......................] duration:
5.850222701s
FAIL (2025-08-19 05:48:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.85024258s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X.............X........X.....................X........] duration:
1.826296124s
FAIL (2025-08-19 05:48:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.826321392s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X..........................XX.....................] duration:
6.012516665s
FAIL (2025-08-19 05:48:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 6.012541324s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X.............X........X.....................X.......] duration:
1.874309565s
FAIL (2025-08-19 05:47:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.874354462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X..........................XX....................] duration:
5.802224592s
FAIL (2025-08-19 05:47:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.802254359s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X.............X........X.....................X......] duration:
1.813697189s
FAIL (2025-08-19 05:47:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.813732626s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X..........................XX...................] duration:
5.813116591s
FAIL (2025-08-19 05:47:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.813151097s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.............X........X.....................X.....] duration:
1.819212501s
FAIL (2025-08-19 05:46:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.819263319s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X............X..........................XX..................] duration:
5.661024367s
FAIL (2025-08-19 05:46:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.661051088s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.............X........X.....................X....] duration:
2.283287718s
FAIL (2025-08-19 05:45:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.283316633s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X............X..........................XX.................] duration:
5.712234724s
FAIL (2025-08-19 05:45:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.712254181s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.............X........X.....................X...] duration:
1.824123479s
FAIL (2025-08-19 05:44:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.824150149s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X............X..........................XX................] duration:
5.986219679s
FAIL (2025-08-19 05:44:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.986244767s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X.............X........X.....................X..] duration:
1.99560859s
FAIL (2025-08-19 05:43:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.995634729s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X............X..........................XX...............] duration:
5.926529638s
FAIL (2025-08-19 05:43:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.926554084s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.............X........X.....................X.] duration:
1.795299247s
FAIL (2025-08-19 05:42:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.795332149s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X............X..........................XX..............] duration:
5.85151766s
FAIL (2025-08-19 05:42:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.85154433s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.............X........X.....................X] duration:
864.665601ms
FAIL (2025-08-19 05:41:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:41:56.339166716 (252h15m50.770246847s) [upload=262354]: Starting upload Aug 19 05:41:56.339226109 (252h15m50.77030624s) [upload=262354]: Done starting upload Aug 19 05:41:56.339282777 (252h15m50.770362909s) [upload=262354]: Uploading segments... Aug 19 05:41:56.339324086 (252h15m50.770404217s) [upload=262354]: Got next segment. Inline: true Aug 19 05:41:56.339329126 (252h15m50.770409257s) [upload=262354]: Waiting for error group managing segments... Aug 19 05:41:56.339366798 (252h15m50.770446929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:41:56.339371798 (252h15m50.770451929s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:41:56.339374843 (252h15m50.770454974s) [upload=262354]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:41:56.552470803 (252h15m50.983550934s) [upload=262354]: Done uploading segments... Aug 19 05:41:56.552487555 (252h15m50.983567686s) [upload=262354]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.686351ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X............X..........................XX.............] duration:
5.693204199s
FAIL (2025-08-19 05:41:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.693230989s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.....X............X..........................XX............] duration:
5.765877804s
FAIL (2025-08-19 05:41:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.765901158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.............X........X.....................] duration:
1.839780958s
FAIL (2025-08-19 05:40:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:26:30.409694733 (252h0m24.840774864s) [upload=262082]: Starting upload Aug 19 05:26:30.409747313 (252h0m24.840827444s) [upload=262082]: Done starting upload Aug 19 05:26:30.409829090 (252h0m24.840909221s) [upload=262082]: Uploading segments... Aug 19 05:26:30.409867564 (252h0m24.840947695s) [upload=262082]: Got next segment. Inline: true Aug 19 05:26:30.409871642 (252h0m24.840951773s) [upload=262082]: Waiting for error group managing segments... Aug 19 05:26:30.409905056 (252h0m24.840985187s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:26:30.409909053 (252h0m24.840989184s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:26:30.409911437 (252h0m24.840991569s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:26:30.624658731 (252h0m25.055738862s) [upload=262082]: Done uploading segments... Aug 19 05:26:30.624677747 (252h0m25.055757878s) [upload=262082]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.839810364s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.............X........X....................] duration:
1.874486032s
FAIL (2025-08-19 05:40:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:26:30.409694733 (252h0m24.840774864s) [upload=262082]: Starting upload Aug 19 05:26:30.409747313 (252h0m24.840827444s) [upload=262082]: Done starting upload Aug 19 05:26:30.409829090 (252h0m24.840909221s) [upload=262082]: Uploading segments... Aug 19 05:26:30.409867564 (252h0m24.840947695s) [upload=262082]: Got next segment. Inline: true Aug 19 05:26:30.409871642 (252h0m24.840951773s) [upload=262082]: Waiting for error group managing segments... Aug 19 05:26:30.409905056 (252h0m24.840985187s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:26:30.409909053 (252h0m24.840989184s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:26:30.409911437 (252h0m24.840991569s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:26:30.624658731 (252h0m25.055738862s) [upload=262082]: Done uploading segments... Aug 19 05:26:30.624677747 (252h0m25.055757878s) [upload=262082]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.874504517s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.....X............X..........................XX...........] duration:
5.869227626s
FAIL (2025-08-19 05:40:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.869247944s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.....X............X..........................XX..........] duration:
6.403150199s
FAIL (2025-08-19 05:40:09 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 6.403181267s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.............X........X...................] duration:
1.866367006s
FAIL (2025-08-19 05:39:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:26:30.409694733 (252h0m24.840774864s) [upload=262082]: Starting upload Aug 19 05:26:30.409747313 (252h0m24.840827444s) [upload=262082]: Done starting upload Aug 19 05:26:30.409829090 (252h0m24.840909221s) [upload=262082]: Uploading segments... Aug 19 05:26:30.409867564 (252h0m24.840947695s) [upload=262082]: Got next segment. Inline: true Aug 19 05:26:30.409871642 (252h0m24.840951773s) [upload=262082]: Waiting for error group managing segments... Aug 19 05:26:30.409905056 (252h0m24.840985187s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:26:30.409909053 (252h0m24.840989184s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:26:30.409911437 (252h0m24.840991569s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:26:30.624658731 (252h0m25.055738862s) [upload=262082]: Done uploading segments... Aug 19 05:26:30.624677747 (252h0m25.055757878s) [upload=262082]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.866390432s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X.....X............X..........................XX.........] duration:
5.850005798s
FAIL (2025-08-19 05:39:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.850030405s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X.....X............X..........................XX........] duration:
5.679702537s
FAIL (2025-08-19 05:39:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.67972548s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.............X........X..................] duration:
2.097535819s
FAIL (2025-08-19 05:38:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:26:30.409694733 (252h0m24.840774864s) [upload=262082]: Starting upload Aug 19 05:26:30.409747313 (252h0m24.840827444s) [upload=262082]: Done starting upload Aug 19 05:26:30.409829090 (252h0m24.840909221s) [upload=262082]: Uploading segments... Aug 19 05:26:30.409867564 (252h0m24.840947695s) [upload=262082]: Got next segment. Inline: true Aug 19 05:26:30.409871642 (252h0m24.840951773s) [upload=262082]: Waiting for error group managing segments... Aug 19 05:26:30.409905056 (252h0m24.840985187s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:26:30.409909053 (252h0m24.840989184s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:26:30.409911437 (252h0m24.840991569s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:26:30.624658731 (252h0m25.055738862s) [upload=262082]: Done uploading segments... Aug 19 05:26:30.624677747 (252h0m25.055757878s) [upload=262082]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.097560164s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.............X........X.................] duration:
1.812854694s
FAIL (2025-08-19 05:37:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:26:30.409694733 (252h0m24.840774864s) [upload=262082]: Starting upload Aug 19 05:26:30.409747313 (252h0m24.840827444s) [upload=262082]: Done starting upload Aug 19 05:26:30.409829090 (252h0m24.840909221s) [upload=262082]: Uploading segments... Aug 19 05:26:30.409867564 (252h0m24.840947695s) [upload=262082]: Got next segment. Inline: true Aug 19 05:26:30.409871642 (252h0m24.840951773s) [upload=262082]: Waiting for error group managing segments... Aug 19 05:26:30.409905056 (252h0m24.840985187s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:26:30.409909053 (252h0m24.840989184s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:26:30.409911437 (252h0m24.840991569s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:26:30.624658731 (252h0m25.055738862s) [upload=262082]: Done uploading segments... Aug 19 05:26:30.624677747 (252h0m25.055757878s) [upload=262082]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.812885341s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....X.....X............X..........................XX.......] duration:
5.779747835s
FAIL (2025-08-19 05:37:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.77977693s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.............X........X................] duration:
4.002480498s
FAIL (2025-08-19 05:37:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:26:30.409694733 (252h0m24.840774864s) [upload=262082]: Starting upload Aug 19 05:26:30.409747313 (252h0m24.840827444s) [upload=262082]: Done starting upload Aug 19 05:26:30.409829090 (252h0m24.840909221s) [upload=262082]: Uploading segments... Aug 19 05:26:30.409867564 (252h0m24.840947695s) [upload=262082]: Got next segment. Inline: true Aug 19 05:26:30.409871642 (252h0m24.840951773s) [upload=262082]: Waiting for error group managing segments... Aug 19 05:26:30.409905056 (252h0m24.840985187s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:26:30.409909053 (252h0m24.840989184s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:26:30.409911437 (252h0m24.840991569s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:26:30.624658731 (252h0m25.055738862s) [upload=262082]: Done uploading segments... Aug 19 05:26:30.624677747 (252h0m25.055757878s) [upload=262082]: Upload finished. err: metaclient: Too Many Requests
Duration: 4.00258653s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......X.....X............X..........................XX......] duration:
5.647371423s
FAIL (2025-08-19 05:37:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 9fa590177fd52dbbaaf889cf72fbd6367c287cb61baa3012cb9f3630d7f15a07 != before b33734a29af67d430dd28c2dcafb7ad05ba70aee807f8441ecea82ef396df259
======LOGS======
Aug 19 05:32:44.887962424 (252h6m39.319042545s) [upload=262191]: Starting upload
Aug 19 05:32:44.888010605 (252h6m39.319090736s) [upload=262191]: Done starting upload
Aug 19 05:32:44.888137007 (252h6m39.319217139s) [upload=262191]: Uploading segments...
Aug 19 05:32:44.888268549 (252h6m39.31934868s) [upload=262191]: Got next segment. Inline: false
Aug 19 05:32:44.888314096 (252h6m39.319394227s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 05:32:44.888320399 (252h6m39.31940053s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 05:32:45.333335862 (252h6m39.764415993s) [seg_pos={0 0}, upload=262191]: Begin upload segment...
Aug 19 05:32:45.333383293 (252h6m39.764463424s) [seg_pos={0 0}, upload=262191]: Done begin upload segment.
Aug 19 05:32:45.333406047 (252h6m39.764486178s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333459068 (252h6m39.764539199s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333824838 (252h6m39.764904969s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.333975936 (252h6m39.765056067s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334113561 (252h6m39.765193692s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334427782 (252h6m39.765507903s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334693069 (252h6m39.7657732s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.334951483 (252h6m39.766031615s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335188497 (252h6m39.766268628s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335426993 (252h6m39.766507124s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335488321 (252h6m39.766568452s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335763648 (252h6m39.766843779s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.335991884 (252h6m39.767072005s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336229399 (252h6m39.76730953s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336425424 (252h6m39.767505555s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336669611 (252h6m39.767749742s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.336910953 (252h6m39.767991084s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:45.337076891 (252h6m39.768157012s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Uploading piece...
Aug 19 05:32:46.517242810 (252h6m40.948322931s) [upload=262191]: Next returned nil segment
Aug 19 05:32:46.517262767 (252h6m40.948342908s) [upload=262191]: Waiting for error group managing segments...
Aug 19 05:32:46.820909864 (252h6m41.251989995s) [noise=true , address=66.23.193.175:4559 , piece_id=CQDDPIMMHSUGOHGCBJEIPFWMYCDHN7GBKZZJAJ7HL4KWVHPYXNVQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.175311845 (252h6m41.606391976s) [noise=true , address=79.127.220.98:4430 , piece_id=TLKGUGKSWI2DTBS62A75RIUUVBVYKAN46EBQUFGBMLG5WMJWVB6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.179415407 (252h6m41.610495528s) [noise=true , address=79.127.220.101:4041 , piece_id=QHI3TVG5TWMNJ6SGU6XD7DXXMXNO3Z7NYK6WSM2IVGBFOLQHAQ6Q, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.188288916 (252h6m41.619369047s) [noise=true , address=79.127.219.51:4199 , piece_id=4IXNIKNX5HS4QMPPXHC3UP73ZLHDIBXOMDRM7MVPUUPJWA6I5QIA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.219454258 (252h6m41.650534389s) [noise=true , address=79.127.219.51:4211 , piece_id=E4DTKLBBKN63FSAIGDHSWKQ4RFXHVLTWXTVZVCSF4UMCTHOWRGXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.305628376 (252h6m41.736708507s) [noise=true , address=45.91.116.13:4158 , piece_id=TYRXMIWXRSCW3JS622OS6B3SRZAOI75HRYVMTNXUBS3375H6SV7A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.316158685 (252h6m41.747238816s) [noise=true , address=79.127.201.215:4358 , piece_id=TFMDPHDSK2RTVTSCGUAN65FKCBTSYYTNTS6NQGZRHLFVV3QTHGCA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.331692227 (252h6m41.762772358s) [noise=true , address=45.91.116.9:4282 , piece_id=S3XFQTA4RJ6O77B6S5YULLSUJBEXNU5P2O44DJ75PYVV7ZGVPLXQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.347026248 (252h6m41.778106379s) [noise=true , address=45.91.116.4:4968 , piece_id=2XBCDLJJE4SG7FYFL2H43S32RGKLJONDMWDJHLRGJCWWFWEDU3IA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.369081579 (252h6m41.800161711s) [noise=true , address=104.36.82.23:4467 , piece_id=GSXN6UMEB52APDPC2EZPN4I6GGMEQACNXOQGVQVQSD6X2SIOSI6A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.406176036 (252h6m41.837256167s) [noise=true , address=77.90.31.17:4804 , piece_id=7HDBZRX75D4ESK3CXKNAXKIVJG4JXJ3TMZYVKQ773AGJ7LOBPNBA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.411986935 (252h6m41.843067066s) [noise=true , address=77.90.31.10:4549 , piece_id=2D2QTOTQQ2IU3HYRQXJREZLSVEBYISJ3ESS67RQPWLIHBEP3KU3A, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.435269625 (252h6m41.866349786s) [noise=true , address=45.91.116.8:4068 , piece_id=M67XWHTDWIQBFOT4ULY4T3DIHK2XOMUEQAGXKXJH7ONYNDESO7DQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453021472 (252h6m41.884101603s) [noise=true , address=77.90.31.18:4839 , piece_id=S65VOEK6MLCIN3L43HFRXVQA5GZ7NWJ5ZNQYAMFO6FYETDSJVDSQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: <nil>
Aug 19 05:32:47.453043134 (252h6m41.884123265s) [seg_pos={0 0}, upload=262191]: Segment reached optimal threshold of 14 pieces.
Aug 19 05:32:47.453134037 (252h6m41.884214158s) [noise=true , address=77.90.31.19:4847 , piece_id=GKTEARH64DXTLJ2N33S26RZDUHV7KFJ7E5DUNJGNNCVFLTUTBFZQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453188561 (252h6m41.884268693s) [noise=true , address=77.90.31.21:4902 , piece_id=HQLINMJ7LKBII45TJV7WKVR6VHSC5V4KM56YKKAWJW5BYSCCCHRQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sD3HFEaYLm7KV6uRvjbojtU9eQGMSy3Aewr4pX5Bxjy4jMCHx): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453246592 (252h6m41.884326774s) [noise=true , address=104.36.82.60:4371 , piece_id=RRS7VMV3NXCGM4JTKRQ2NGJPYAETF3OHGNFB5LYWADOFBMQXGUWQ, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453280849 (252h6m41.88436098s) [noise=true , address=45.91.116.11:4146 , piece_id=7MCSZ5TG5W24NCQXCXIGO72A5VNISYLGKEY6YJLPNK76MZCUNVRA, seg_pos={0 0}, upload=262191]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VJf4TrDJ7So1W3XuGbfnbKMWC8ftHReLgqfWGqjpRWAbwCjrp): protocol: expected piece hash; context canceled; EOF
Aug 19 05:32:47.453291288 (252h6m41.884371419s) [seg_pos={0 0}, upload=262191]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 05:32:47.453342216 (252h6m41.884422347s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 05:32:47.453345993 (252h6m41.884426124s) [upload=262191]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 05:32:47.734101438 (252h6m42.165181569s) [upload=262191]: Done uploading segments...
Aug 19 05:32:47.734121846 (252h6m42.165202007s) [upload=262191]: Upload finished. err: <nil>
Duration: 5.647401701s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.............X........X...............] duration:
2.262205369s
FAIL (2025-08-19 05:36:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:26:30.409694733 (252h0m24.840774864s) [upload=262082]: Starting upload Aug 19 05:26:30.409747313 (252h0m24.840827444s) [upload=262082]: Done starting upload Aug 19 05:26:30.409829090 (252h0m24.840909221s) [upload=262082]: Uploading segments... Aug 19 05:26:30.409867564 (252h0m24.840947695s) [upload=262082]: Got next segment. Inline: true Aug 19 05:26:30.409871642 (252h0m24.840951773s) [upload=262082]: Waiting for error group managing segments... Aug 19 05:26:30.409905056 (252h0m24.840985187s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:26:30.409909053 (252h0m24.840989184s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:26:30.409911437 (252h0m24.840991569s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:26:30.624658731 (252h0m25.055738862s) [upload=262082]: Done uploading segments... Aug 19 05:26:30.624677747 (252h0m25.055757878s) [upload=262082]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.262230128s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.............X........X..............] duration:
2.061653851s
FAIL (2025-08-19 05:36:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 05:26:30.409694733 (252h0m24.840774864s) [upload=262082]: Starting upload Aug 19 05:26:30.409747313 (252h0m24.840827444s) [upload=262082]: Done starting upload Aug 19 05:26:30.409829090 (252h0m24.840909221s) [upload=262082]: Uploading segments... Aug 19 05:26:30.409867564 (252h0m24.840947695s) [upload=262082]: Got next segment. Inline: true Aug 19 05:26:30.409871642 (252h0m24.840951773s) [upload=262082]: Waiting for error group managing segments... Aug 19 05:26:30.409905056 (252h0m24.840985187s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 05:26:30.409909053 (252h0m24.840989184s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 05:26:30.409911437 (252h0m24.840991569s) [upload=262082]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 05:26:30.624658731 (252h0m25.055738862s) [upload=262082]: Done uploading segments... Aug 19 05:26:30.624677747 (252h0m25.055757878s) [upload=262082]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.061759442s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|