Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X..........X.X.......X..............................] duration:
2.264251097s
FAIL (2025-08-18 23:32:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.264280623s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X.X.....................X........................X....] duration:
6.232293246s
FAIL (2025-08-18 23:32:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c0ddb8035a1798ccd51e1f16958fb65e1b8defa26723eadcc05c5bf17ba1b388 != before aa213783a0f35e9dbb3465b63c2d1eb1a3f5621055566e28cdb63ccb796e6a54
======LOGS======
Aug 18 23:28:55.350285311 (246h2m49.781365432s) [upload=255937]: Starting upload
Aug 18 23:28:55.350336950 (246h2m49.781417081s) [upload=255937]: Done starting upload
Aug 18 23:28:55.350426342 (246h2m49.781506473s) [upload=255937]: Uploading segments...
Aug 18 23:28:55.350515372 (246h2m49.781595493s) [upload=255937]: Got next segment. Inline: false
Aug 18 23:28:55.350541673 (246h2m49.781621794s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:28:55.350545971 (246h2m49.781626102s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:28:55.915899993 (246h2m50.346980124s) [seg_pos={0 0}, upload=255937]: Begin upload segment...
Aug 18 23:28:55.915952133 (246h2m50.347032264s) [seg_pos={0 0}, upload=255937]: Done begin upload segment.
Aug 18 23:28:55.916002910 (246h2m50.347083091s) [noise=true , address=104.36.82.35:4595 , piece_id=WIOWC6VD7QD6E4WRDEEDLBGHVDZ7FE43YS6J7LYBV23B66YV3NXQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916152206 (246h2m50.347232337s) [noise=true , address=45.91.116.12:4258 , piece_id=ZGCSFCSLTWZAQWEMWIQBMHMFXNMPFGLACHZS6XSL3RELMJSUIS7A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916632335 (246h2m50.347712466s) [noise=true , address=79.127.219.48:4083 , piece_id=SSZX2CBMRBBLMHDX2DJLSWVMCAUS2F2VAXODFKEMN7ZP6PC4RFMQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916670197 (246h2m50.347750318s) [noise=true , address=77.90.31.17:4775 , piece_id=EE46BXFXXLEEYIESGC6KRZIWTRWSDBGBNHL6Y4XZNFTAI5WE4FPA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916977135 (246h2m50.348057256s) [noise=true , address=104.36.82.17:4342 , piece_id=35YNNRWJOODEIQK4HSAFGHUWDX57HRZUPTFTMOIJKKP3TLSH6PDQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917128464 (246h2m50.348208595s) [noise=true , address=45.91.116.8:4059 , piece_id=F72X3QMWACBJQ3KCISRFVHQP6G3IMKDBILPNDBQVRX5ZGLNL4QEQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917338536 (246h2m50.348418657s) [noise=true , address=77.90.31.19:4861 , piece_id=HDSOYZFITWYRKJRBR2UULMRWDIXHLLWUCNS4HAYLKK22FW44Z3XQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917439709 (246h2m50.34851984s) [noise=true , address=104.36.82.5:4851 , piece_id=COIMFN3EC4NU2CZQJIT4Z3XYLNMP2TQCV4I7LTFAJSIQ4KO4UP4A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917626777 (246h2m50.348706898s) [noise=true , address=77.90.31.10:4552 , piece_id=TH2DAQLMEMRSFAFUXI24IOGRB2VM66BRZAFUIUNEW5NOL2ML5ETA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917749933 (246h2m50.348830064s) [noise=true , address=77.90.31.13:4638 , piece_id=Q2Y6O6SJH6A6PXMOUORMFEEZGIIZMBHL6D75BDOCTSFQ6PPWAHYQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917937422 (246h2m50.349017543s) [noise=true , address=77.90.31.12:4604 , piece_id=TKOZ6CIO4QKEFPJNTTKSJ5ZR6SE6F6QS3GZZB2RZJMNDOAOKXD4A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918121153 (246h2m50.349201274s) [noise=true , address=104.36.82.40:4976 , piece_id=YC7OSJYM3YOOJGVC6PRGYR4KEZSOOXZLJCXGUTH7L4VTK4OB35TQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918259798 (246h2m50.349339929s) [noise=true , address=104.36.82.44:4876 , piece_id=HJNKZBWPH57BYTYEAVOK4WPXIIG2IU7RJODCB7NFYRNQAHKWOQEA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918542981 (246h2m50.349623112s) [noise=true , address=104.36.82.4:4819 , piece_id=ARV6YCVUF5MCTM7LRGY3MIUZPEDGPJHISOAKWSRODSTIIU6EHUIA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918802838 (246h2m50.349882969s) [noise=true , address=45.91.116.14:4215 , piece_id=NXY4JMPB5PIGERBJ6KIAJIZ3GIZVYLBGKZQFCHWMA6COMME6LHNA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.919931588 (246h2m50.351011719s) [noise=true , address=104.36.82.12:4158 , piece_id=QQ6BGJMT3S6RY4PRMJIQHAILPD4Q5Z2KNNXJBAEDJ5IUZOGXJV2Q, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.921638664 (246h2m50.352718795s) [noise=true , address=104.36.82.15:4284 , piece_id=MGP5Z3ZUVF7TZ6IFOSWVUIEIPNMP2Z7ZSUV6SGC6LKS723KYTGYQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.922103935 (246h2m50.353184066s) [noise=true , address=79.127.205.245:4235 , piece_id=45OT23BIOY263657DW7VQ3B6FE45DTMWBPBOE7NILLPEBWIRA3JQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:57.066044842 (246h2m51.497124973s) [upload=255937]: Next returned nil segment
Aug 18 23:28:57.066059681 (246h2m51.497139812s) [upload=255937]: Waiting for error group managing segments...
Aug 18 23:28:57.369623542 (246h2m51.800703673s) [noise=true , address=79.127.205.245:4235 , piece_id=45OT23BIOY263657DW7VQ3B6FE45DTMWBPBOE7NILLPEBWIRA3JQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.773433800 (246h2m52.204513931s) [noise=true , address=79.127.219.48:4083 , piece_id=SSZX2CBMRBBLMHDX2DJLSWVMCAUS2F2VAXODFKEMN7ZP6PC4RFMQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.847417333 (246h2m52.278497464s) [noise=true , address=104.36.82.15:4284 , piece_id=MGP5Z3ZUVF7TZ6IFOSWVUIEIPNMP2Z7ZSUV6SGC6LKS723KYTGYQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.886818846 (246h2m52.317898977s) [noise=true , address=45.91.116.14:4215 , piece_id=NXY4JMPB5PIGERBJ6KIAJIZ3GIZVYLBGKZQFCHWMA6COMME6LHNA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.946971686 (246h2m52.378051817s) [noise=true , address=104.36.82.35:4595 , piece_id=WIOWC6VD7QD6E4WRDEEDLBGHVDZ7FE43YS6J7LYBV23B66YV3NXQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.950339729 (246h2m52.38141986s) [noise=true , address=77.90.31.13:4638 , piece_id=Q2Y6O6SJH6A6PXMOUORMFEEZGIIZMBHL6D75BDOCTSFQ6PPWAHYQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.983397775 (246h2m52.414477896s) [noise=true , address=77.90.31.17:4775 , piece_id=EE46BXFXXLEEYIESGC6KRZIWTRWSDBGBNHL6Y4XZNFTAI5WE4FPA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.021302142 (246h2m52.452382273s) [noise=true , address=77.90.31.12:4604 , piece_id=TKOZ6CIO4QKEFPJNTTKSJ5ZR6SE6F6QS3GZZB2RZJMNDOAOKXD4A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.042745883 (246h2m52.473826014s) [noise=true , address=104.36.82.4:4819 , piece_id=ARV6YCVUF5MCTM7LRGY3MIUZPEDGPJHISOAKWSRODSTIIU6EHUIA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.071732688 (246h2m52.50281282s) [noise=true , address=45.91.116.12:4258 , piece_id=ZGCSFCSLTWZAQWEMWIQBMHMFXNMPFGLACHZS6XSL3RELMJSUIS7A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.072971118 (246h2m52.504051249s) [noise=true , address=45.91.116.8:4059 , piece_id=F72X3QMWACBJQ3KCISRFVHQP6G3IMKDBILPNDBQVRX5ZGLNL4QEQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.082255042 (246h2m52.513335173s) [noise=true , address=104.36.82.17:4342 , piece_id=35YNNRWJOODEIQK4HSAFGHUWDX57HRZUPTFTMOIJKKP3TLSH6PDQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.092113907 (246h2m52.523194038s) [noise=true , address=77.90.31.10:4552 , piece_id=TH2DAQLMEMRSFAFUXI24IOGRB2VM66BRZAFUIUNEW5NOL2ML5ETA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.105671318 (246h2m52.536751449s) [noise=true , address=104.36.82.40:4976 , piece_id=YC7OSJYM3YOOJGVC6PRGYR4KEZSOOXZLJCXGUTH7L4VTK4OB35TQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.105688722 (246h2m52.536768853s) [seg_pos={0 0}, upload=255937]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:28:58.105855420 (246h2m52.536935552s) [noise=true , address=104.36.82.44:4876 , piece_id=HJNKZBWPH57BYTYEAVOK4WPXIIG2IU7RJODCB7NFYRNQAHKWOQEA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Aug 18 23:28:58.105917128 (246h2m52.536997259s) [noise=true , address=77.90.31.19:4861 , piece_id=HDSOYZFITWYRKJRBR2UULMRWDIXHLLWUCNS4HAYLKK22FW44Z3XQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MXMA4zbRGtLCJaAfF2BchSfazrAR7ToZnpazHkNEapzzm44QQ): protocol: write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection; write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection
Aug 18 23:28:58.105961484 (246h2m52.537041605s) [noise=true , address=104.36.82.12:4158 , piece_id=QQ6BGJMT3S6RY4PRMJIQHAILPD4Q5Z2KNNXJBAEDJ5IUZOGXJV2Q, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SjM6Utm2YizeUbrBUD9Z7etE1nLadW5Fa1zYP7MioPeeqhdJ7): protocol: write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection; write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection
Aug 18 23:28:58.106010446 (246h2m52.537090578s) [noise=true , address=104.36.82.5:4851 , piece_id=COIMFN3EC4NU2CZQJIT4Z3XYLNMP2TQCV4I7LTFAJSIQ4KO4UP4A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R): protocol: read tcp 188.166.225.170:56442->104.36.82.5:4851: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 23:28:58.106032118 (246h2m52.537112249s) [seg_pos={0 0}, upload=255937]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:28:58.106083166 (246h2m52.537163297s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:28:58.106088656 (246h2m52.537168787s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:28:58.396368300 (246h2m52.827448431s) [upload=255937]: Done uploading segments...
Aug 18 23:28:58.396389381 (246h2m52.827469512s) [upload=255937]: Upload finished. err: <nil>
Duration: 6.232326009s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X..........X.X.......X.............................] duration:
2.583593371s
FAIL (2025-08-18 23:31:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.583619611s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.X.....................X........................X...] duration:
6.685068088s
FAIL (2025-08-18 23:31:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c0ddb8035a1798ccd51e1f16958fb65e1b8defa26723eadcc05c5bf17ba1b388 != before aa213783a0f35e9dbb3465b63c2d1eb1a3f5621055566e28cdb63ccb796e6a54
======LOGS======
Aug 18 23:28:55.350285311 (246h2m49.781365432s) [upload=255937]: Starting upload
Aug 18 23:28:55.350336950 (246h2m49.781417081s) [upload=255937]: Done starting upload
Aug 18 23:28:55.350426342 (246h2m49.781506473s) [upload=255937]: Uploading segments...
Aug 18 23:28:55.350515372 (246h2m49.781595493s) [upload=255937]: Got next segment. Inline: false
Aug 18 23:28:55.350541673 (246h2m49.781621794s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:28:55.350545971 (246h2m49.781626102s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:28:55.915899993 (246h2m50.346980124s) [seg_pos={0 0}, upload=255937]: Begin upload segment...
Aug 18 23:28:55.915952133 (246h2m50.347032264s) [seg_pos={0 0}, upload=255937]: Done begin upload segment.
Aug 18 23:28:55.916002910 (246h2m50.347083091s) [noise=true , address=104.36.82.35:4595 , piece_id=WIOWC6VD7QD6E4WRDEEDLBGHVDZ7FE43YS6J7LYBV23B66YV3NXQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916152206 (246h2m50.347232337s) [noise=true , address=45.91.116.12:4258 , piece_id=ZGCSFCSLTWZAQWEMWIQBMHMFXNMPFGLACHZS6XSL3RELMJSUIS7A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916632335 (246h2m50.347712466s) [noise=true , address=79.127.219.48:4083 , piece_id=SSZX2CBMRBBLMHDX2DJLSWVMCAUS2F2VAXODFKEMN7ZP6PC4RFMQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916670197 (246h2m50.347750318s) [noise=true , address=77.90.31.17:4775 , piece_id=EE46BXFXXLEEYIESGC6KRZIWTRWSDBGBNHL6Y4XZNFTAI5WE4FPA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916977135 (246h2m50.348057256s) [noise=true , address=104.36.82.17:4342 , piece_id=35YNNRWJOODEIQK4HSAFGHUWDX57HRZUPTFTMOIJKKP3TLSH6PDQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917128464 (246h2m50.348208595s) [noise=true , address=45.91.116.8:4059 , piece_id=F72X3QMWACBJQ3KCISRFVHQP6G3IMKDBILPNDBQVRX5ZGLNL4QEQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917338536 (246h2m50.348418657s) [noise=true , address=77.90.31.19:4861 , piece_id=HDSOYZFITWYRKJRBR2UULMRWDIXHLLWUCNS4HAYLKK22FW44Z3XQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917439709 (246h2m50.34851984s) [noise=true , address=104.36.82.5:4851 , piece_id=COIMFN3EC4NU2CZQJIT4Z3XYLNMP2TQCV4I7LTFAJSIQ4KO4UP4A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917626777 (246h2m50.348706898s) [noise=true , address=77.90.31.10:4552 , piece_id=TH2DAQLMEMRSFAFUXI24IOGRB2VM66BRZAFUIUNEW5NOL2ML5ETA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917749933 (246h2m50.348830064s) [noise=true , address=77.90.31.13:4638 , piece_id=Q2Y6O6SJH6A6PXMOUORMFEEZGIIZMBHL6D75BDOCTSFQ6PPWAHYQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917937422 (246h2m50.349017543s) [noise=true , address=77.90.31.12:4604 , piece_id=TKOZ6CIO4QKEFPJNTTKSJ5ZR6SE6F6QS3GZZB2RZJMNDOAOKXD4A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918121153 (246h2m50.349201274s) [noise=true , address=104.36.82.40:4976 , piece_id=YC7OSJYM3YOOJGVC6PRGYR4KEZSOOXZLJCXGUTH7L4VTK4OB35TQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918259798 (246h2m50.349339929s) [noise=true , address=104.36.82.44:4876 , piece_id=HJNKZBWPH57BYTYEAVOK4WPXIIG2IU7RJODCB7NFYRNQAHKWOQEA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918542981 (246h2m50.349623112s) [noise=true , address=104.36.82.4:4819 , piece_id=ARV6YCVUF5MCTM7LRGY3MIUZPEDGPJHISOAKWSRODSTIIU6EHUIA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918802838 (246h2m50.349882969s) [noise=true , address=45.91.116.14:4215 , piece_id=NXY4JMPB5PIGERBJ6KIAJIZ3GIZVYLBGKZQFCHWMA6COMME6LHNA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.919931588 (246h2m50.351011719s) [noise=true , address=104.36.82.12:4158 , piece_id=QQ6BGJMT3S6RY4PRMJIQHAILPD4Q5Z2KNNXJBAEDJ5IUZOGXJV2Q, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.921638664 (246h2m50.352718795s) [noise=true , address=104.36.82.15:4284 , piece_id=MGP5Z3ZUVF7TZ6IFOSWVUIEIPNMP2Z7ZSUV6SGC6LKS723KYTGYQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.922103935 (246h2m50.353184066s) [noise=true , address=79.127.205.245:4235 , piece_id=45OT23BIOY263657DW7VQ3B6FE45DTMWBPBOE7NILLPEBWIRA3JQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:57.066044842 (246h2m51.497124973s) [upload=255937]: Next returned nil segment
Aug 18 23:28:57.066059681 (246h2m51.497139812s) [upload=255937]: Waiting for error group managing segments...
Aug 18 23:28:57.369623542 (246h2m51.800703673s) [noise=true , address=79.127.205.245:4235 , piece_id=45OT23BIOY263657DW7VQ3B6FE45DTMWBPBOE7NILLPEBWIRA3JQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.773433800 (246h2m52.204513931s) [noise=true , address=79.127.219.48:4083 , piece_id=SSZX2CBMRBBLMHDX2DJLSWVMCAUS2F2VAXODFKEMN7ZP6PC4RFMQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.847417333 (246h2m52.278497464s) [noise=true , address=104.36.82.15:4284 , piece_id=MGP5Z3ZUVF7TZ6IFOSWVUIEIPNMP2Z7ZSUV6SGC6LKS723KYTGYQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.886818846 (246h2m52.317898977s) [noise=true , address=45.91.116.14:4215 , piece_id=NXY4JMPB5PIGERBJ6KIAJIZ3GIZVYLBGKZQFCHWMA6COMME6LHNA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.946971686 (246h2m52.378051817s) [noise=true , address=104.36.82.35:4595 , piece_id=WIOWC6VD7QD6E4WRDEEDLBGHVDZ7FE43YS6J7LYBV23B66YV3NXQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.950339729 (246h2m52.38141986s) [noise=true , address=77.90.31.13:4638 , piece_id=Q2Y6O6SJH6A6PXMOUORMFEEZGIIZMBHL6D75BDOCTSFQ6PPWAHYQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.983397775 (246h2m52.414477896s) [noise=true , address=77.90.31.17:4775 , piece_id=EE46BXFXXLEEYIESGC6KRZIWTRWSDBGBNHL6Y4XZNFTAI5WE4FPA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.021302142 (246h2m52.452382273s) [noise=true , address=77.90.31.12:4604 , piece_id=TKOZ6CIO4QKEFPJNTTKSJ5ZR6SE6F6QS3GZZB2RZJMNDOAOKXD4A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.042745883 (246h2m52.473826014s) [noise=true , address=104.36.82.4:4819 , piece_id=ARV6YCVUF5MCTM7LRGY3MIUZPEDGPJHISOAKWSRODSTIIU6EHUIA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.071732688 (246h2m52.50281282s) [noise=true , address=45.91.116.12:4258 , piece_id=ZGCSFCSLTWZAQWEMWIQBMHMFXNMPFGLACHZS6XSL3RELMJSUIS7A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.072971118 (246h2m52.504051249s) [noise=true , address=45.91.116.8:4059 , piece_id=F72X3QMWACBJQ3KCISRFVHQP6G3IMKDBILPNDBQVRX5ZGLNL4QEQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.082255042 (246h2m52.513335173s) [noise=true , address=104.36.82.17:4342 , piece_id=35YNNRWJOODEIQK4HSAFGHUWDX57HRZUPTFTMOIJKKP3TLSH6PDQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.092113907 (246h2m52.523194038s) [noise=true , address=77.90.31.10:4552 , piece_id=TH2DAQLMEMRSFAFUXI24IOGRB2VM66BRZAFUIUNEW5NOL2ML5ETA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.105671318 (246h2m52.536751449s) [noise=true , address=104.36.82.40:4976 , piece_id=YC7OSJYM3YOOJGVC6PRGYR4KEZSOOXZLJCXGUTH7L4VTK4OB35TQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.105688722 (246h2m52.536768853s) [seg_pos={0 0}, upload=255937]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:28:58.105855420 (246h2m52.536935552s) [noise=true , address=104.36.82.44:4876 , piece_id=HJNKZBWPH57BYTYEAVOK4WPXIIG2IU7RJODCB7NFYRNQAHKWOQEA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Aug 18 23:28:58.105917128 (246h2m52.536997259s) [noise=true , address=77.90.31.19:4861 , piece_id=HDSOYZFITWYRKJRBR2UULMRWDIXHLLWUCNS4HAYLKK22FW44Z3XQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MXMA4zbRGtLCJaAfF2BchSfazrAR7ToZnpazHkNEapzzm44QQ): protocol: write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection; write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection
Aug 18 23:28:58.105961484 (246h2m52.537041605s) [noise=true , address=104.36.82.12:4158 , piece_id=QQ6BGJMT3S6RY4PRMJIQHAILPD4Q5Z2KNNXJBAEDJ5IUZOGXJV2Q, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SjM6Utm2YizeUbrBUD9Z7etE1nLadW5Fa1zYP7MioPeeqhdJ7): protocol: write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection; write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection
Aug 18 23:28:58.106010446 (246h2m52.537090578s) [noise=true , address=104.36.82.5:4851 , piece_id=COIMFN3EC4NU2CZQJIT4Z3XYLNMP2TQCV4I7LTFAJSIQ4KO4UP4A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R): protocol: read tcp 188.166.225.170:56442->104.36.82.5:4851: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 23:28:58.106032118 (246h2m52.537112249s) [seg_pos={0 0}, upload=255937]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:28:58.106083166 (246h2m52.537163297s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:28:58.106088656 (246h2m52.537168787s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:28:58.396368300 (246h2m52.827448431s) [upload=255937]: Done uploading segments...
Aug 18 23:28:58.396389381 (246h2m52.827469512s) [upload=255937]: Upload finished. err: <nil>
Duration: 6.685092046s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X..........X.X.......X............................] duration:
1.979511483s
FAIL (2025-08-18 23:30:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.979535679s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X.X.....................X........................X..] duration:
5.873920983s
FAIL (2025-08-18 23:30:09 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c0ddb8035a1798ccd51e1f16958fb65e1b8defa26723eadcc05c5bf17ba1b388 != before aa213783a0f35e9dbb3465b63c2d1eb1a3f5621055566e28cdb63ccb796e6a54
======LOGS======
Aug 18 23:28:55.350285311 (246h2m49.781365432s) [upload=255937]: Starting upload
Aug 18 23:28:55.350336950 (246h2m49.781417081s) [upload=255937]: Done starting upload
Aug 18 23:28:55.350426342 (246h2m49.781506473s) [upload=255937]: Uploading segments...
Aug 18 23:28:55.350515372 (246h2m49.781595493s) [upload=255937]: Got next segment. Inline: false
Aug 18 23:28:55.350541673 (246h2m49.781621794s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:28:55.350545971 (246h2m49.781626102s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:28:55.915899993 (246h2m50.346980124s) [seg_pos={0 0}, upload=255937]: Begin upload segment...
Aug 18 23:28:55.915952133 (246h2m50.347032264s) [seg_pos={0 0}, upload=255937]: Done begin upload segment.
Aug 18 23:28:55.916002910 (246h2m50.347083091s) [noise=true , address=104.36.82.35:4595 , piece_id=WIOWC6VD7QD6E4WRDEEDLBGHVDZ7FE43YS6J7LYBV23B66YV3NXQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916152206 (246h2m50.347232337s) [noise=true , address=45.91.116.12:4258 , piece_id=ZGCSFCSLTWZAQWEMWIQBMHMFXNMPFGLACHZS6XSL3RELMJSUIS7A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916632335 (246h2m50.347712466s) [noise=true , address=79.127.219.48:4083 , piece_id=SSZX2CBMRBBLMHDX2DJLSWVMCAUS2F2VAXODFKEMN7ZP6PC4RFMQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916670197 (246h2m50.347750318s) [noise=true , address=77.90.31.17:4775 , piece_id=EE46BXFXXLEEYIESGC6KRZIWTRWSDBGBNHL6Y4XZNFTAI5WE4FPA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916977135 (246h2m50.348057256s) [noise=true , address=104.36.82.17:4342 , piece_id=35YNNRWJOODEIQK4HSAFGHUWDX57HRZUPTFTMOIJKKP3TLSH6PDQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917128464 (246h2m50.348208595s) [noise=true , address=45.91.116.8:4059 , piece_id=F72X3QMWACBJQ3KCISRFVHQP6G3IMKDBILPNDBQVRX5ZGLNL4QEQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917338536 (246h2m50.348418657s) [noise=true , address=77.90.31.19:4861 , piece_id=HDSOYZFITWYRKJRBR2UULMRWDIXHLLWUCNS4HAYLKK22FW44Z3XQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917439709 (246h2m50.34851984s) [noise=true , address=104.36.82.5:4851 , piece_id=COIMFN3EC4NU2CZQJIT4Z3XYLNMP2TQCV4I7LTFAJSIQ4KO4UP4A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917626777 (246h2m50.348706898s) [noise=true , address=77.90.31.10:4552 , piece_id=TH2DAQLMEMRSFAFUXI24IOGRB2VM66BRZAFUIUNEW5NOL2ML5ETA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917749933 (246h2m50.348830064s) [noise=true , address=77.90.31.13:4638 , piece_id=Q2Y6O6SJH6A6PXMOUORMFEEZGIIZMBHL6D75BDOCTSFQ6PPWAHYQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917937422 (246h2m50.349017543s) [noise=true , address=77.90.31.12:4604 , piece_id=TKOZ6CIO4QKEFPJNTTKSJ5ZR6SE6F6QS3GZZB2RZJMNDOAOKXD4A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918121153 (246h2m50.349201274s) [noise=true , address=104.36.82.40:4976 , piece_id=YC7OSJYM3YOOJGVC6PRGYR4KEZSOOXZLJCXGUTH7L4VTK4OB35TQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918259798 (246h2m50.349339929s) [noise=true , address=104.36.82.44:4876 , piece_id=HJNKZBWPH57BYTYEAVOK4WPXIIG2IU7RJODCB7NFYRNQAHKWOQEA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918542981 (246h2m50.349623112s) [noise=true , address=104.36.82.4:4819 , piece_id=ARV6YCVUF5MCTM7LRGY3MIUZPEDGPJHISOAKWSRODSTIIU6EHUIA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918802838 (246h2m50.349882969s) [noise=true , address=45.91.116.14:4215 , piece_id=NXY4JMPB5PIGERBJ6KIAJIZ3GIZVYLBGKZQFCHWMA6COMME6LHNA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.919931588 (246h2m50.351011719s) [noise=true , address=104.36.82.12:4158 , piece_id=QQ6BGJMT3S6RY4PRMJIQHAILPD4Q5Z2KNNXJBAEDJ5IUZOGXJV2Q, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.921638664 (246h2m50.352718795s) [noise=true , address=104.36.82.15:4284 , piece_id=MGP5Z3ZUVF7TZ6IFOSWVUIEIPNMP2Z7ZSUV6SGC6LKS723KYTGYQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.922103935 (246h2m50.353184066s) [noise=true , address=79.127.205.245:4235 , piece_id=45OT23BIOY263657DW7VQ3B6FE45DTMWBPBOE7NILLPEBWIRA3JQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:57.066044842 (246h2m51.497124973s) [upload=255937]: Next returned nil segment
Aug 18 23:28:57.066059681 (246h2m51.497139812s) [upload=255937]: Waiting for error group managing segments...
Aug 18 23:28:57.369623542 (246h2m51.800703673s) [noise=true , address=79.127.205.245:4235 , piece_id=45OT23BIOY263657DW7VQ3B6FE45DTMWBPBOE7NILLPEBWIRA3JQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.773433800 (246h2m52.204513931s) [noise=true , address=79.127.219.48:4083 , piece_id=SSZX2CBMRBBLMHDX2DJLSWVMCAUS2F2VAXODFKEMN7ZP6PC4RFMQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.847417333 (246h2m52.278497464s) [noise=true , address=104.36.82.15:4284 , piece_id=MGP5Z3ZUVF7TZ6IFOSWVUIEIPNMP2Z7ZSUV6SGC6LKS723KYTGYQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.886818846 (246h2m52.317898977s) [noise=true , address=45.91.116.14:4215 , piece_id=NXY4JMPB5PIGERBJ6KIAJIZ3GIZVYLBGKZQFCHWMA6COMME6LHNA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.946971686 (246h2m52.378051817s) [noise=true , address=104.36.82.35:4595 , piece_id=WIOWC6VD7QD6E4WRDEEDLBGHVDZ7FE43YS6J7LYBV23B66YV3NXQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.950339729 (246h2m52.38141986s) [noise=true , address=77.90.31.13:4638 , piece_id=Q2Y6O6SJH6A6PXMOUORMFEEZGIIZMBHL6D75BDOCTSFQ6PPWAHYQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.983397775 (246h2m52.414477896s) [noise=true , address=77.90.31.17:4775 , piece_id=EE46BXFXXLEEYIESGC6KRZIWTRWSDBGBNHL6Y4XZNFTAI5WE4FPA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.021302142 (246h2m52.452382273s) [noise=true , address=77.90.31.12:4604 , piece_id=TKOZ6CIO4QKEFPJNTTKSJ5ZR6SE6F6QS3GZZB2RZJMNDOAOKXD4A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.042745883 (246h2m52.473826014s) [noise=true , address=104.36.82.4:4819 , piece_id=ARV6YCVUF5MCTM7LRGY3MIUZPEDGPJHISOAKWSRODSTIIU6EHUIA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.071732688 (246h2m52.50281282s) [noise=true , address=45.91.116.12:4258 , piece_id=ZGCSFCSLTWZAQWEMWIQBMHMFXNMPFGLACHZS6XSL3RELMJSUIS7A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.072971118 (246h2m52.504051249s) [noise=true , address=45.91.116.8:4059 , piece_id=F72X3QMWACBJQ3KCISRFVHQP6G3IMKDBILPNDBQVRX5ZGLNL4QEQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.082255042 (246h2m52.513335173s) [noise=true , address=104.36.82.17:4342 , piece_id=35YNNRWJOODEIQK4HSAFGHUWDX57HRZUPTFTMOIJKKP3TLSH6PDQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.092113907 (246h2m52.523194038s) [noise=true , address=77.90.31.10:4552 , piece_id=TH2DAQLMEMRSFAFUXI24IOGRB2VM66BRZAFUIUNEW5NOL2ML5ETA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.105671318 (246h2m52.536751449s) [noise=true , address=104.36.82.40:4976 , piece_id=YC7OSJYM3YOOJGVC6PRGYR4KEZSOOXZLJCXGUTH7L4VTK4OB35TQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.105688722 (246h2m52.536768853s) [seg_pos={0 0}, upload=255937]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:28:58.105855420 (246h2m52.536935552s) [noise=true , address=104.36.82.44:4876 , piece_id=HJNKZBWPH57BYTYEAVOK4WPXIIG2IU7RJODCB7NFYRNQAHKWOQEA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Aug 18 23:28:58.105917128 (246h2m52.536997259s) [noise=true , address=77.90.31.19:4861 , piece_id=HDSOYZFITWYRKJRBR2UULMRWDIXHLLWUCNS4HAYLKK22FW44Z3XQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MXMA4zbRGtLCJaAfF2BchSfazrAR7ToZnpazHkNEapzzm44QQ): protocol: write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection; write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection
Aug 18 23:28:58.105961484 (246h2m52.537041605s) [noise=true , address=104.36.82.12:4158 , piece_id=QQ6BGJMT3S6RY4PRMJIQHAILPD4Q5Z2KNNXJBAEDJ5IUZOGXJV2Q, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SjM6Utm2YizeUbrBUD9Z7etE1nLadW5Fa1zYP7MioPeeqhdJ7): protocol: write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection; write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection
Aug 18 23:28:58.106010446 (246h2m52.537090578s) [noise=true , address=104.36.82.5:4851 , piece_id=COIMFN3EC4NU2CZQJIT4Z3XYLNMP2TQCV4I7LTFAJSIQ4KO4UP4A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R): protocol: read tcp 188.166.225.170:56442->104.36.82.5:4851: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 23:28:58.106032118 (246h2m52.537112249s) [seg_pos={0 0}, upload=255937]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:28:58.106083166 (246h2m52.537163297s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:28:58.106088656 (246h2m52.537168787s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:28:58.396368300 (246h2m52.827448431s) [upload=255937]: Done uploading segments...
Aug 18 23:28:58.396389381 (246h2m52.827469512s) [upload=255937]: Upload finished. err: <nil>
Duration: 5.873948004s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X..........X.X.......X...........................] duration:
2.236816039s
FAIL (2025-08-18 23:29:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.236842779s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X.X.....................X........................X.] duration:
8.296346296s
FAIL (2025-08-18 23:29:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c0ddb8035a1798ccd51e1f16958fb65e1b8defa26723eadcc05c5bf17ba1b388 != before aa213783a0f35e9dbb3465b63c2d1eb1a3f5621055566e28cdb63ccb796e6a54
======LOGS======
Aug 18 23:28:55.350285311 (246h2m49.781365432s) [upload=255937]: Starting upload
Aug 18 23:28:55.350336950 (246h2m49.781417081s) [upload=255937]: Done starting upload
Aug 18 23:28:55.350426342 (246h2m49.781506473s) [upload=255937]: Uploading segments...
Aug 18 23:28:55.350515372 (246h2m49.781595493s) [upload=255937]: Got next segment. Inline: false
Aug 18 23:28:55.350541673 (246h2m49.781621794s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:28:55.350545971 (246h2m49.781626102s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:28:55.915899993 (246h2m50.346980124s) [seg_pos={0 0}, upload=255937]: Begin upload segment...
Aug 18 23:28:55.915952133 (246h2m50.347032264s) [seg_pos={0 0}, upload=255937]: Done begin upload segment.
Aug 18 23:28:55.916002910 (246h2m50.347083091s) [noise=true , address=104.36.82.35:4595 , piece_id=WIOWC6VD7QD6E4WRDEEDLBGHVDZ7FE43YS6J7LYBV23B66YV3NXQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916152206 (246h2m50.347232337s) [noise=true , address=45.91.116.12:4258 , piece_id=ZGCSFCSLTWZAQWEMWIQBMHMFXNMPFGLACHZS6XSL3RELMJSUIS7A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916632335 (246h2m50.347712466s) [noise=true , address=79.127.219.48:4083 , piece_id=SSZX2CBMRBBLMHDX2DJLSWVMCAUS2F2VAXODFKEMN7ZP6PC4RFMQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916670197 (246h2m50.347750318s) [noise=true , address=77.90.31.17:4775 , piece_id=EE46BXFXXLEEYIESGC6KRZIWTRWSDBGBNHL6Y4XZNFTAI5WE4FPA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916977135 (246h2m50.348057256s) [noise=true , address=104.36.82.17:4342 , piece_id=35YNNRWJOODEIQK4HSAFGHUWDX57HRZUPTFTMOIJKKP3TLSH6PDQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917128464 (246h2m50.348208595s) [noise=true , address=45.91.116.8:4059 , piece_id=F72X3QMWACBJQ3KCISRFVHQP6G3IMKDBILPNDBQVRX5ZGLNL4QEQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917338536 (246h2m50.348418657s) [noise=true , address=77.90.31.19:4861 , piece_id=HDSOYZFITWYRKJRBR2UULMRWDIXHLLWUCNS4HAYLKK22FW44Z3XQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917439709 (246h2m50.34851984s) [noise=true , address=104.36.82.5:4851 , piece_id=COIMFN3EC4NU2CZQJIT4Z3XYLNMP2TQCV4I7LTFAJSIQ4KO4UP4A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917626777 (246h2m50.348706898s) [noise=true , address=77.90.31.10:4552 , piece_id=TH2DAQLMEMRSFAFUXI24IOGRB2VM66BRZAFUIUNEW5NOL2ML5ETA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917749933 (246h2m50.348830064s) [noise=true , address=77.90.31.13:4638 , piece_id=Q2Y6O6SJH6A6PXMOUORMFEEZGIIZMBHL6D75BDOCTSFQ6PPWAHYQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917937422 (246h2m50.349017543s) [noise=true , address=77.90.31.12:4604 , piece_id=TKOZ6CIO4QKEFPJNTTKSJ5ZR6SE6F6QS3GZZB2RZJMNDOAOKXD4A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918121153 (246h2m50.349201274s) [noise=true , address=104.36.82.40:4976 , piece_id=YC7OSJYM3YOOJGVC6PRGYR4KEZSOOXZLJCXGUTH7L4VTK4OB35TQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918259798 (246h2m50.349339929s) [noise=true , address=104.36.82.44:4876 , piece_id=HJNKZBWPH57BYTYEAVOK4WPXIIG2IU7RJODCB7NFYRNQAHKWOQEA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918542981 (246h2m50.349623112s) [noise=true , address=104.36.82.4:4819 , piece_id=ARV6YCVUF5MCTM7LRGY3MIUZPEDGPJHISOAKWSRODSTIIU6EHUIA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918802838 (246h2m50.349882969s) [noise=true , address=45.91.116.14:4215 , piece_id=NXY4JMPB5PIGERBJ6KIAJIZ3GIZVYLBGKZQFCHWMA6COMME6LHNA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.919931588 (246h2m50.351011719s) [noise=true , address=104.36.82.12:4158 , piece_id=QQ6BGJMT3S6RY4PRMJIQHAILPD4Q5Z2KNNXJBAEDJ5IUZOGXJV2Q, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.921638664 (246h2m50.352718795s) [noise=true , address=104.36.82.15:4284 , piece_id=MGP5Z3ZUVF7TZ6IFOSWVUIEIPNMP2Z7ZSUV6SGC6LKS723KYTGYQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.922103935 (246h2m50.353184066s) [noise=true , address=79.127.205.245:4235 , piece_id=45OT23BIOY263657DW7VQ3B6FE45DTMWBPBOE7NILLPEBWIRA3JQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:57.066044842 (246h2m51.497124973s) [upload=255937]: Next returned nil segment
Aug 18 23:28:57.066059681 (246h2m51.497139812s) [upload=255937]: Waiting for error group managing segments...
Aug 18 23:28:57.369623542 (246h2m51.800703673s) [noise=true , address=79.127.205.245:4235 , piece_id=45OT23BIOY263657DW7VQ3B6FE45DTMWBPBOE7NILLPEBWIRA3JQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.773433800 (246h2m52.204513931s) [noise=true , address=79.127.219.48:4083 , piece_id=SSZX2CBMRBBLMHDX2DJLSWVMCAUS2F2VAXODFKEMN7ZP6PC4RFMQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.847417333 (246h2m52.278497464s) [noise=true , address=104.36.82.15:4284 , piece_id=MGP5Z3ZUVF7TZ6IFOSWVUIEIPNMP2Z7ZSUV6SGC6LKS723KYTGYQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.886818846 (246h2m52.317898977s) [noise=true , address=45.91.116.14:4215 , piece_id=NXY4JMPB5PIGERBJ6KIAJIZ3GIZVYLBGKZQFCHWMA6COMME6LHNA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.946971686 (246h2m52.378051817s) [noise=true , address=104.36.82.35:4595 , piece_id=WIOWC6VD7QD6E4WRDEEDLBGHVDZ7FE43YS6J7LYBV23B66YV3NXQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.950339729 (246h2m52.38141986s) [noise=true , address=77.90.31.13:4638 , piece_id=Q2Y6O6SJH6A6PXMOUORMFEEZGIIZMBHL6D75BDOCTSFQ6PPWAHYQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.983397775 (246h2m52.414477896s) [noise=true , address=77.90.31.17:4775 , piece_id=EE46BXFXXLEEYIESGC6KRZIWTRWSDBGBNHL6Y4XZNFTAI5WE4FPA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.021302142 (246h2m52.452382273s) [noise=true , address=77.90.31.12:4604 , piece_id=TKOZ6CIO4QKEFPJNTTKSJ5ZR6SE6F6QS3GZZB2RZJMNDOAOKXD4A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.042745883 (246h2m52.473826014s) [noise=true , address=104.36.82.4:4819 , piece_id=ARV6YCVUF5MCTM7LRGY3MIUZPEDGPJHISOAKWSRODSTIIU6EHUIA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.071732688 (246h2m52.50281282s) [noise=true , address=45.91.116.12:4258 , piece_id=ZGCSFCSLTWZAQWEMWIQBMHMFXNMPFGLACHZS6XSL3RELMJSUIS7A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.072971118 (246h2m52.504051249s) [noise=true , address=45.91.116.8:4059 , piece_id=F72X3QMWACBJQ3KCISRFVHQP6G3IMKDBILPNDBQVRX5ZGLNL4QEQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.082255042 (246h2m52.513335173s) [noise=true , address=104.36.82.17:4342 , piece_id=35YNNRWJOODEIQK4HSAFGHUWDX57HRZUPTFTMOIJKKP3TLSH6PDQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.092113907 (246h2m52.523194038s) [noise=true , address=77.90.31.10:4552 , piece_id=TH2DAQLMEMRSFAFUXI24IOGRB2VM66BRZAFUIUNEW5NOL2ML5ETA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.105671318 (246h2m52.536751449s) [noise=true , address=104.36.82.40:4976 , piece_id=YC7OSJYM3YOOJGVC6PRGYR4KEZSOOXZLJCXGUTH7L4VTK4OB35TQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.105688722 (246h2m52.536768853s) [seg_pos={0 0}, upload=255937]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:28:58.105855420 (246h2m52.536935552s) [noise=true , address=104.36.82.44:4876 , piece_id=HJNKZBWPH57BYTYEAVOK4WPXIIG2IU7RJODCB7NFYRNQAHKWOQEA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Aug 18 23:28:58.105917128 (246h2m52.536997259s) [noise=true , address=77.90.31.19:4861 , piece_id=HDSOYZFITWYRKJRBR2UULMRWDIXHLLWUCNS4HAYLKK22FW44Z3XQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MXMA4zbRGtLCJaAfF2BchSfazrAR7ToZnpazHkNEapzzm44QQ): protocol: write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection; write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection
Aug 18 23:28:58.105961484 (246h2m52.537041605s) [noise=true , address=104.36.82.12:4158 , piece_id=QQ6BGJMT3S6RY4PRMJIQHAILPD4Q5Z2KNNXJBAEDJ5IUZOGXJV2Q, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SjM6Utm2YizeUbrBUD9Z7etE1nLadW5Fa1zYP7MioPeeqhdJ7): protocol: write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection; write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection
Aug 18 23:28:58.106010446 (246h2m52.537090578s) [noise=true , address=104.36.82.5:4851 , piece_id=COIMFN3EC4NU2CZQJIT4Z3XYLNMP2TQCV4I7LTFAJSIQ4KO4UP4A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R): protocol: read tcp 188.166.225.170:56442->104.36.82.5:4851: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 23:28:58.106032118 (246h2m52.537112249s) [seg_pos={0 0}, upload=255937]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:28:58.106083166 (246h2m52.537163297s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:28:58.106088656 (246h2m52.537168787s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:28:58.396368300 (246h2m52.827448431s) [upload=255937]: Done uploading segments...
Aug 18 23:28:58.396389381 (246h2m52.827469512s) [upload=255937]: Upload finished. err: <nil>
Duration: 8.296372315s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X.X.....................X........................X] duration:
6.091966135s
FAIL (2025-08-18 23:29:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after c0ddb8035a1798ccd51e1f16958fb65e1b8defa26723eadcc05c5bf17ba1b388 != before aa213783a0f35e9dbb3465b63c2d1eb1a3f5621055566e28cdb63ccb796e6a54
======LOGS======
Aug 18 23:28:55.350285311 (246h2m49.781365432s) [upload=255937]: Starting upload
Aug 18 23:28:55.350336950 (246h2m49.781417081s) [upload=255937]: Done starting upload
Aug 18 23:28:55.350426342 (246h2m49.781506473s) [upload=255937]: Uploading segments...
Aug 18 23:28:55.350515372 (246h2m49.781595493s) [upload=255937]: Got next segment. Inline: false
Aug 18 23:28:55.350541673 (246h2m49.781621794s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:28:55.350545971 (246h2m49.781626102s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:28:55.915899993 (246h2m50.346980124s) [seg_pos={0 0}, upload=255937]: Begin upload segment...
Aug 18 23:28:55.915952133 (246h2m50.347032264s) [seg_pos={0 0}, upload=255937]: Done begin upload segment.
Aug 18 23:28:55.916002910 (246h2m50.347083091s) [noise=true , address=104.36.82.35:4595 , piece_id=WIOWC6VD7QD6E4WRDEEDLBGHVDZ7FE43YS6J7LYBV23B66YV3NXQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916152206 (246h2m50.347232337s) [noise=true , address=45.91.116.12:4258 , piece_id=ZGCSFCSLTWZAQWEMWIQBMHMFXNMPFGLACHZS6XSL3RELMJSUIS7A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916632335 (246h2m50.347712466s) [noise=true , address=79.127.219.48:4083 , piece_id=SSZX2CBMRBBLMHDX2DJLSWVMCAUS2F2VAXODFKEMN7ZP6PC4RFMQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916670197 (246h2m50.347750318s) [noise=true , address=77.90.31.17:4775 , piece_id=EE46BXFXXLEEYIESGC6KRZIWTRWSDBGBNHL6Y4XZNFTAI5WE4FPA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.916977135 (246h2m50.348057256s) [noise=true , address=104.36.82.17:4342 , piece_id=35YNNRWJOODEIQK4HSAFGHUWDX57HRZUPTFTMOIJKKP3TLSH6PDQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917128464 (246h2m50.348208595s) [noise=true , address=45.91.116.8:4059 , piece_id=F72X3QMWACBJQ3KCISRFVHQP6G3IMKDBILPNDBQVRX5ZGLNL4QEQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917338536 (246h2m50.348418657s) [noise=true , address=77.90.31.19:4861 , piece_id=HDSOYZFITWYRKJRBR2UULMRWDIXHLLWUCNS4HAYLKK22FW44Z3XQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917439709 (246h2m50.34851984s) [noise=true , address=104.36.82.5:4851 , piece_id=COIMFN3EC4NU2CZQJIT4Z3XYLNMP2TQCV4I7LTFAJSIQ4KO4UP4A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917626777 (246h2m50.348706898s) [noise=true , address=77.90.31.10:4552 , piece_id=TH2DAQLMEMRSFAFUXI24IOGRB2VM66BRZAFUIUNEW5NOL2ML5ETA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917749933 (246h2m50.348830064s) [noise=true , address=77.90.31.13:4638 , piece_id=Q2Y6O6SJH6A6PXMOUORMFEEZGIIZMBHL6D75BDOCTSFQ6PPWAHYQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.917937422 (246h2m50.349017543s) [noise=true , address=77.90.31.12:4604 , piece_id=TKOZ6CIO4QKEFPJNTTKSJ5ZR6SE6F6QS3GZZB2RZJMNDOAOKXD4A, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918121153 (246h2m50.349201274s) [noise=true , address=104.36.82.40:4976 , piece_id=YC7OSJYM3YOOJGVC6PRGYR4KEZSOOXZLJCXGUTH7L4VTK4OB35TQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918259798 (246h2m50.349339929s) [noise=true , address=104.36.82.44:4876 , piece_id=HJNKZBWPH57BYTYEAVOK4WPXIIG2IU7RJODCB7NFYRNQAHKWOQEA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918542981 (246h2m50.349623112s) [noise=true , address=104.36.82.4:4819 , piece_id=ARV6YCVUF5MCTM7LRGY3MIUZPEDGPJHISOAKWSRODSTIIU6EHUIA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.918802838 (246h2m50.349882969s) [noise=true , address=45.91.116.14:4215 , piece_id=NXY4JMPB5PIGERBJ6KIAJIZ3GIZVYLBGKZQFCHWMA6COMME6LHNA, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.919931588 (246h2m50.351011719s) [noise=true , address=104.36.82.12:4158 , piece_id=QQ6BGJMT3S6RY4PRMJIQHAILPD4Q5Z2KNNXJBAEDJ5IUZOGXJV2Q, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.921638664 (246h2m50.352718795s) [noise=true , address=104.36.82.15:4284 , piece_id=MGP5Z3ZUVF7TZ6IFOSWVUIEIPNMP2Z7ZSUV6SGC6LKS723KYTGYQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:55.922103935 (246h2m50.353184066s) [noise=true , address=79.127.205.245:4235 , piece_id=45OT23BIOY263657DW7VQ3B6FE45DTMWBPBOE7NILLPEBWIRA3JQ, seg_pos={0 0}, upload=255937]: Uploading piece...
Aug 18 23:28:57.066044842 (246h2m51.497124973s) [upload=255937]: Next returned nil segment
Aug 18 23:28:57.066059681 (246h2m51.497139812s) [upload=255937]: Waiting for error group managing segments...
Aug 18 23:28:57.369623542 (246h2m51.800703673s) [noise=true , address=79.127.205.245:4235 , piece_id=45OT23BIOY263657DW7VQ3B6FE45DTMWBPBOE7NILLPEBWIRA3JQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.773433800 (246h2m52.204513931s) [noise=true , address=79.127.219.48:4083 , piece_id=SSZX2CBMRBBLMHDX2DJLSWVMCAUS2F2VAXODFKEMN7ZP6PC4RFMQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.847417333 (246h2m52.278497464s) [noise=true , address=104.36.82.15:4284 , piece_id=MGP5Z3ZUVF7TZ6IFOSWVUIEIPNMP2Z7ZSUV6SGC6LKS723KYTGYQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.886818846 (246h2m52.317898977s) [noise=true , address=45.91.116.14:4215 , piece_id=NXY4JMPB5PIGERBJ6KIAJIZ3GIZVYLBGKZQFCHWMA6COMME6LHNA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.946971686 (246h2m52.378051817s) [noise=true , address=104.36.82.35:4595 , piece_id=WIOWC6VD7QD6E4WRDEEDLBGHVDZ7FE43YS6J7LYBV23B66YV3NXQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.950339729 (246h2m52.38141986s) [noise=true , address=77.90.31.13:4638 , piece_id=Q2Y6O6SJH6A6PXMOUORMFEEZGIIZMBHL6D75BDOCTSFQ6PPWAHYQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:57.983397775 (246h2m52.414477896s) [noise=true , address=77.90.31.17:4775 , piece_id=EE46BXFXXLEEYIESGC6KRZIWTRWSDBGBNHL6Y4XZNFTAI5WE4FPA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.021302142 (246h2m52.452382273s) [noise=true , address=77.90.31.12:4604 , piece_id=TKOZ6CIO4QKEFPJNTTKSJ5ZR6SE6F6QS3GZZB2RZJMNDOAOKXD4A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.042745883 (246h2m52.473826014s) [noise=true , address=104.36.82.4:4819 , piece_id=ARV6YCVUF5MCTM7LRGY3MIUZPEDGPJHISOAKWSRODSTIIU6EHUIA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.071732688 (246h2m52.50281282s) [noise=true , address=45.91.116.12:4258 , piece_id=ZGCSFCSLTWZAQWEMWIQBMHMFXNMPFGLACHZS6XSL3RELMJSUIS7A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.072971118 (246h2m52.504051249s) [noise=true , address=45.91.116.8:4059 , piece_id=F72X3QMWACBJQ3KCISRFVHQP6G3IMKDBILPNDBQVRX5ZGLNL4QEQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.082255042 (246h2m52.513335173s) [noise=true , address=104.36.82.17:4342 , piece_id=35YNNRWJOODEIQK4HSAFGHUWDX57HRZUPTFTMOIJKKP3TLSH6PDQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.092113907 (246h2m52.523194038s) [noise=true , address=77.90.31.10:4552 , piece_id=TH2DAQLMEMRSFAFUXI24IOGRB2VM66BRZAFUIUNEW5NOL2ML5ETA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.105671318 (246h2m52.536751449s) [noise=true , address=104.36.82.40:4976 , piece_id=YC7OSJYM3YOOJGVC6PRGYR4KEZSOOXZLJCXGUTH7L4VTK4OB35TQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: <nil>
Aug 18 23:28:58.105688722 (246h2m52.536768853s) [seg_pos={0 0}, upload=255937]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:28:58.105855420 (246h2m52.536935552s) [noise=true , address=104.36.82.44:4876 , piece_id=HJNKZBWPH57BYTYEAVOK4WPXIIG2IU7RJODCB7NFYRNQAHKWOQEA, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF
Aug 18 23:28:58.105917128 (246h2m52.536997259s) [noise=true , address=77.90.31.19:4861 , piece_id=HDSOYZFITWYRKJRBR2UULMRWDIXHLLWUCNS4HAYLKK22FW44Z3XQ, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MXMA4zbRGtLCJaAfF2BchSfazrAR7ToZnpazHkNEapzzm44QQ): protocol: write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection; write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33812->77.90.31.19:4861: use of closed network connection
Aug 18 23:28:58.105961484 (246h2m52.537041605s) [noise=true , address=104.36.82.12:4158 , piece_id=QQ6BGJMT3S6RY4PRMJIQHAILPD4Q5Z2KNNXJBAEDJ5IUZOGXJV2Q, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SjM6Utm2YizeUbrBUD9Z7etE1nLadW5Fa1zYP7MioPeeqhdJ7): protocol: write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection; write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49296->104.36.82.12:4158: use of closed network connection
Aug 18 23:28:58.106010446 (246h2m52.537090578s) [noise=true , address=104.36.82.5:4851 , piece_id=COIMFN3EC4NU2CZQJIT4Z3XYLNMP2TQCV4I7LTFAJSIQ4KO4UP4A, seg_pos={0 0}, upload=255937]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R): protocol: read tcp 188.166.225.170:56442->104.36.82.5:4851: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 23:28:58.106032118 (246h2m52.537112249s) [seg_pos={0 0}, upload=255937]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:28:58.106083166 (246h2m52.537163297s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:28:58.106088656 (246h2m52.537168787s) [upload=255937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:28:58.396368300 (246h2m52.827448431s) [upload=255937]: Done uploading segments...
Aug 18 23:28:58.396389381 (246h2m52.827469512s) [upload=255937]: Upload finished. err: <nil>
Duration: 6.091992826s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X..........X.X.......X..........................] duration:
1.890060798s
FAIL (2025-08-18 23:28:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.89008893s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X..........X.X.......X.........................] duration:
1.873182667s
FAIL (2025-08-18 23:28:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.873203077s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.X.....................X........................] duration:
6.539795466s
FAIL (2025-08-18 23:27:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.539821074s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X..........X.X.......X........................] duration:
1.905502158s
FAIL (2025-08-18 23:27:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.90556567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.X.....................X.......................] duration:
7.24375099s
FAIL (2025-08-18 23:27:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 7.243779043s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X..........X.X.......X.......................] duration:
1.865630803s
FAIL (2025-08-18 23:26:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.865663365s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.X.....................X......................] duration:
7.681294992s
FAIL (2025-08-18 23:26:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 7.681323538s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X..........X.X.......X......................] duration:
1.897213931s
FAIL (2025-08-18 23:26:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.897238468s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X..........X.X.......X.....................] duration:
2.743761384s
FAIL (2025-08-18 23:25:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.743793134s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.............X.X.....................X.....................] duration:
6.645597656s
FAIL (2025-08-18 23:25:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.645623205s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X..........X.X.......X....................] duration:
1.869362098s
FAIL (2025-08-18 23:24:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.86938851s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.............X.X.....................X....................] duration:
6.041939996s
FAIL (2025-08-18 23:24:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.04196278s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X..........X.X.......X...................] duration:
1.846376157s
FAIL (2025-08-18 23:23:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.846402779s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.............X.X.....................X...................] duration:
7.60063398s
FAIL (2025-08-18 23:23:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 7.600651963s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X..........X.X.......X..................] duration:
1.932180604s
FAIL (2025-08-18 23:22:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.93221076s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X..........X.X.......X.................] duration:
4.62493692s
FAIL (2025-08-18 23:22:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 4.624963191s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.............X.X.....................X..................] duration:
6.675954379s
FAIL (2025-08-18 23:22:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.675982603s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X.............X.X.....................X.................] duration:
6.926837629s
FAIL (2025-08-18 23:21:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.926862547s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X.....................X..........X.X.......X................] duration:
2.263716865s
FAIL (2025-08-18 23:21:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.263732675s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X.............X.X.....................X................] duration:
7.72718922s
FAIL (2025-08-18 23:21:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 7.72721518s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X.............X.X.....................X...............] duration:
6.111929539s
FAIL (2025-08-18 23:20:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.111956659s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X.....................X..........X.X.......X...............] duration:
3.056974535s
FAIL (2025-08-18 23:20:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.057003511s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.............X.X.....................X..............] duration:
6.980313304s
FAIL (2025-08-18 23:20:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.980337571s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X.X.....................X..........X.X.......X..............] duration:
1.988964448s
FAIL (2025-08-18 23:19:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.988994064s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.......X.............X.X.....................X.............] duration:
6.064774708s
FAIL (2025-08-18 23:19:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.064804415s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X.X.....................X..........X.X.......X.............] duration:
2.126355047s
FAIL (2025-08-18 23:18:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.126388551s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.......X.............X.X.....................X............] duration:
6.556234251s
FAIL (2025-08-18 23:18:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.556261803s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X.X.....................X..........X.X.......X............] duration:
2.007304894s
FAIL (2025-08-18 23:17:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.007333169s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.......X.............X.X.....................X...........] duration:
6.531790593s
FAIL (2025-08-18 23:17:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.53180986s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X.X.....................X..........X.X.......X...........] duration:
1.901356629s
FAIL (2025-08-18 23:16:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.901379614s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X.......X.............X.X.....................X..........] duration:
6.655344429s
FAIL (2025-08-18 23:16:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.655365049s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X.X.....................X..........X.X.......X..........] duration:
2.122638526s
FAIL (2025-08-18 23:15:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.122655367s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X.......X.............X.X.....................X.........] duration:
6.949190288s
FAIL (2025-08-18 23:15:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.949218412s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....X.......X.............X.X.....................X........] duration:
6.359296773s
FAIL (2025-08-18 23:14:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.359320538s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X.X.....................X..........X.X.......X.........] duration:
2.098267856s
FAIL (2025-08-18 23:14:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.098293715s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......X.......X.............X.X.....................X.......] duration:
6.658867829s
FAIL (2025-08-18 23:14:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.658884784s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......X.X.....................X..........X.X.......X........] duration:
1.931738812s
FAIL (2025-08-18 23:13:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.931775113s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......X.......X.............X.X.....................X......] duration:
6.625772864s
FAIL (2025-08-18 23:13:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.625798552s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X.X.....................X..........X.X.......X.......] duration:
2.40110687s
FAIL (2025-08-18 23:12:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.401143199s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........X.......X.............X.X.....................X.....] duration:
6.775446391s
FAIL (2025-08-18 23:12:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5a5ec155560ecf54be0a8cd02426c589ad55a73742d0f51de3fb26904c6a33ad != before 854c8c35215323ecd4c63457fa3feaf7e5def513fafb68146a5a69c8a36d9f8c
======LOGS======
Aug 18 23:09:20.630330128 (245h43m15.06141025s) [upload=255597]: Starting upload
Aug 18 23:09:20.630396947 (245h43m15.061477078s) [upload=255597]: Done starting upload
Aug 18 23:09:20.630467782 (245h43m15.061547913s) [upload=255597]: Uploading segments...
Aug 18 23:09:20.630587051 (245h43m15.061667182s) [upload=255597]: Got next segment. Inline: false
Aug 18 23:09:20.630617639 (245h43m15.06169777s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 23:09:20.630635302 (245h43m15.061715443s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 23:09:21.139557974 (245h43m15.570638105s) [seg_pos={0 0}, upload=255597]: Begin upload segment...
Aug 18 23:09:21.139611236 (245h43m15.570691367s) [seg_pos={0 0}, upload=255597]: Done begin upload segment.
Aug 18 23:09:21.139641724 (245h43m15.570721845s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.139650171 (245h43m15.570730302s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140049444 (245h43m15.571129576s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140056469 (245h43m15.5711366s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140081275 (245h43m15.571161396s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140470240 (245h43m15.571550361s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.140740618 (245h43m15.571820739s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141329193 (245h43m15.572409325s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141691376 (245h43m15.572771507s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.141705764 (245h43m15.572785895s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142032219 (245h43m15.57311235s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142314629 (245h43m15.57339476s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142599464 (245h43m15.573679595s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.142869300 (245h43m15.573949431s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143120170 (245h43m15.574200301s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143413241 (245h43m15.574493372s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.143670464 (245h43m15.574750595s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:21.144003441 (245h43m15.575083572s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Uploading piece...
Aug 18 23:09:22.652386678 (245h43m17.083466799s) [upload=255597]: Next returned nil segment
Aug 18 23:09:22.652400234 (245h43m17.083480365s) [upload=255597]: Waiting for error group managing segments...
Aug 18 23:09:23.092683198 (245h43m17.523763329s) [noise=true , address=104.36.82.11:4129 , piece_id=R3F2IEPGYSV3QWKJGBZ6FOTDU7Q5GQXHEEXFZPOXHLPXYYVED5HQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.107419576 (245h43m17.538499707s) [noise=true , address=79.127.201.214:4296 , piece_id=4CWPUT6K6ZNDO4WF2R2HRIOS3MR3WM2WGK57UHGMLEKA2E34HVKA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.145646441 (245h43m17.576726572s) [noise=true , address=45.91.116.7:4020 , piece_id=SJVNTF3Y3CLUKGXPDNTTL5OGTDKLECIKP6I6YQBTNY4YVSHTPD3A, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.203698890 (245h43m17.634779021s) [noise=true , address=77.90.31.21:4898 , piece_id=N3O6DXVJ3E626QVZ3UW4DGCBEIJXNDVLK22HCMY32IOVIARUCY4Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.231347354 (245h43m17.662427485s) [noise=true , address=45.91.116.13:4159 , piece_id=ZVDOKCTWGDWGXIN6GLZXMKRZOEHJHGDQNMGV447DVPQQ54MYBCGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.249894863 (245h43m17.680974984s) [noise=true , address=104.36.82.35:4605 , piece_id=DQF6KY5VP5HIY27ZMWLOC2R4V7DKSR6ZNHYVESYIX7GMBQ5XNSEQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.289793206 (245h43m17.720873337s) [noise=true , address=77.90.31.19:4852 , piece_id=KCQYPFC3PP56BW2WGYBXPIFVHRAI4K3RRRVFX72PAT4C6PS2SAGA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.332087152 (245h43m17.763167273s) [noise=true , address=45.91.116.6:4996 , piece_id=SS6G6QFIH37R6LKJUDR5CBENKOPXZYV6JIMWO5AAPPUCXLKLCSAQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.346853838 (245h43m17.777934009s) [noise=true , address=77.90.31.14:4689 , piece_id=O2NGBG7Y2BAZ6VCR5BDFMVDJPGNUAVDP36SX5OIGVIB77T5WY3XA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.348246151 (245h43m17.779326283s) [noise=true , address=45.91.116.8:4052 , piece_id=GOCLJVSYTKLLUM264MYAPCXSN3TUMBUFLL5MBDEAECBG3GIS56RA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.352687671 (245h43m17.783767802s) [noise=true , address=104.36.82.61:4408 , piece_id=GJJBM2FEARWZDA2XPFUJS5KBIQKMA2DHIWVEGX6B7U6TDFB7NAHQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.408035174 (245h43m17.839115305s) [noise=true , address=104.36.82.13:4212 , piece_id=3R6OJOEOLAE57G4BGISQKLFCECIB6OUQ7ODCD6Z23GAI2DLG6UFA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.451088384 (245h43m17.882168515s) [noise=true , address=104.36.82.45:4915 , piece_id=7I7VBHQWSPDQETZRDVHTKSI4CMD6TDGQ5NALKNPYYT46X6RFNFNQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453911456 (245h43m17.884991577s) [noise=true , address=77.90.31.13:4652 , piece_id=YJ44SKDSRLCBGCDVRDSVMWTUA6WYXEKQCNBFCVH2QPIPYT6VEC2Q, seg_pos={0 0}, upload=255597]: Done uploading piece. err: <nil>
Aug 18 23:09:23.453930443 (245h43m17.885010574s) [seg_pos={0 0}, upload=255597]: Segment reached optimal threshold of 14 pieces.
Aug 18 23:09:23.454046144 (245h43m17.885126275s) [noise=true , address=77.90.31.17:4769 , piece_id=QL6O6FNVWAEUCFADB72I5FO4KRXH23IWHRXWDPAIT4YWE52MOUGQ, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTwUoE6vkVP1pChp2oyoKm47tYCRkfYQXbEKSSH22RxdVxmd): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454101610 (245h43m17.885181731s) [noise=true , address=45.91.116.5:4330 , piece_id=DC4JIFDSBKUYSHWQ6Z2CENAP3WMZETJEGAHHD5PGIJC536MJXOIA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MK9aVDRwfWPfckFR6RfPUL1Nrm9bwfsgV7TXCKGbtadHebWvW): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454120206 (245h43m17.885200337s) [noise=true , address=77.90.31.14:4672 , piece_id=SXTIZVDFAG2WJDYZZ53KIAREKEDBMSCCVX5UWT6BEAIHCMUMD5ZA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454181112 (245h43m17.885261243s) [noise=true , address=45.91.116.12:4231 , piece_id=PDDMQKTSX5YUI4CXA7QGRLC7PGSMYXFNPLKH33VGZDNB2PLFEFXA, seg_pos={0 0}, upload=255597]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NmgZdLWKjrDMmNcgmnzH475akX4WtA9zGTLxZgVW7JpaecBjq): protocol: expected piece hash; context canceled; EOF
Aug 18 23:09:23.454196812 (245h43m17.885276943s) [seg_pos={0 0}, upload=255597]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 23:09:23.454252649 (245h43m17.88533278s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 23:09:23.454256457 (245h43m17.885336588s) [upload=255597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 23:09:24.841963207 (245h43m19.273043338s) [upload=255597]: Done uploading segments...
Aug 18 23:09:24.841981832 (245h43m19.273061963s) [upload=255597]: Upload finished. err: <nil>
Duration: 6.775476176s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X.X.....................X..........X.X.......X......] duration:
1.926034838s
FAIL (2025-08-18 23:11:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 23:07:25.135619572 (245h41m19.566699703s) [upload=255567]: Starting upload Aug 18 23:07:25.135671271 (245h41m19.566751402s) [upload=255567]: Done starting upload Aug 18 23:07:25.135751885 (245h41m19.566832016s) [upload=255567]: Uploading segments... Aug 18 23:07:25.135872786 (245h41m19.566952907s) [upload=255567]: Got next segment. Inline: true Aug 18 23:07:25.135877635 (245h41m19.566957756s) [upload=255567]: Waiting for error group managing segments... Aug 18 23:07:25.135919947 (245h41m19.567000078s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 23:07:25.135926840 (245h41m19.567006971s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 23:07:25.135929244 (245h41m19.567009375s) [upload=255567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 23:07:25.431183154 (245h41m19.862263285s) [upload=255567]: Done uploading segments... Aug 18 23:07:25.431199004 (245h41m19.862279135s) [upload=255567]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.926052392s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|