Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [......X...X..X.X.X......X.X.............X...................] duration:
5.875452226s
FAIL (2025-08-23 06:52:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.875486031s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X....................X...........................] duration:
1.861589907s
FAIL (2025-08-23 06:52:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.86163881s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.......X...X..X.X.X......X.X.............X..................] duration:
5.861745526s
FAIL (2025-08-23 06:51:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.861772989s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [X.......X...X..X.X.X......X.X.............X.................] duration:
5.63357492s
FAIL (2025-08-23 06:51:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.633593646s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X....................X..........................] duration:
1.829908673s
FAIL (2025-08-23 06:51:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.829935334s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [.X.......X...X..X.X.X......X.X.............X................] duration:
5.835501981s
FAIL (2025-08-23 06:50:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.835528711s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [..X.......X...X..X.X.X......X.X.............X...............] duration:
5.754172661s
FAIL (2025-08-23 06:50:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.754200054s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X....................X.........................] duration:
1.865698143s
FAIL (2025-08-23 06:50:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.865737668s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [...X.......X...X..X.X.X......X.X.............X..............] duration:
5.594396536s
FAIL (2025-08-23 06:49:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.594423047s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X....................X........................] duration:
1.806851886s
FAIL (2025-08-23 06:49:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.806883457s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [....X.......X...X..X.X.X......X.X.............X.............] duration:
5.534956783s
FAIL (2025-08-23 06:48:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.53498207s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X....................X.......................] duration:
1.8485546s
FAIL (2025-08-23 06:48:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.848582493s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X....................X......................] duration:
1.881080004s
FAIL (2025-08-23 06:47:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.881107928s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [.....X.......X...X..X.X.X......X.X.............X............] duration:
5.512069712s
FAIL (2025-08-23 06:47:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.512107424s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X....................X.....................] duration:
1.829264994s
FAIL (2025-08-23 06:46:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.829292054s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [......X.......X...X..X.X.X......X.X.............X...........] duration:
5.883280491s
FAIL (2025-08-23 06:46:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.883299216s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X....................X....................] duration:
1.832091311s
FAIL (2025-08-23 06:46:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.832123723s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [.......X.......X...X..X.X.X......X.X.............X..........] duration:
5.615884218s
FAIL (2025-08-23 06:46:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.615920227s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X....................X...................] duration:
1.847045103s
FAIL (2025-08-23 06:45:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.847091611s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [........X.......X...X..X.X.X......X.X.............X.........] duration:
5.68994997s
FAIL (2025-08-23 06:44:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.689985308s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X....................X..................] duration:
1.8095917s
FAIL (2025-08-23 06:44:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.809634902s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [.........X.......X...X..X.X.X......X.X.............X........] duration:
5.605776772s
FAIL (2025-08-23 06:44:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.6058331s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [..........X.......X...X..X.X.X......X.X.............X.......] duration:
5.671618614s
FAIL (2025-08-23 06:43:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.671647248s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X....................X.................] duration:
1.999016055s
FAIL (2025-08-23 06:43:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.999044759s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [...........X.......X...X..X.X.X......X.X.............X......] duration:
5.734241764s
FAIL (2025-08-23 06:42:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.734270218s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [............X.......X...X..X.X.X......X.X.............X.....] duration:
5.722999335s
FAIL (2025-08-23 06:42:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.723022091s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X....................X................] duration:
1.842947381s
FAIL (2025-08-23 06:42:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.842992387s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [.............X.......X...X..X.X.X......X.X.............X....] duration:
5.559259824s
FAIL (2025-08-23 06:41:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.559286516s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X....................X...............] duration:
1.845870975s
FAIL (2025-08-23 06:41:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.845900501s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X....................X..............] duration:
1.817930195s
FAIL (2025-08-23 06:41:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.817956484s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
10 out of 60 is failed (threshold=3) [X.............X.......X...X..X.X.X......X.X.............X...] duration:
5.65356115s
FAIL (2025-08-23 06:40:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.653591839s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X....................X.............] duration:
1.85353002s
FAIL (2025-08-23 06:40:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.853562202s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X....................X............] duration:
1.918340569s
FAIL (2025-08-23 06:40:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.918371179s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
10 out of 60 is failed (threshold=3) [.X.............X.......X...X..X.X.X......X.X.............X..] duration:
5.811119394s
FAIL (2025-08-23 06:39:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.811202975s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X....................X...........] duration:
1.803334666s
FAIL (2025-08-23 06:39:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.803379843s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
10 out of 60 is failed (threshold=3) [..X.............X.......X...X..X.X.X......X.X.............X.] duration:
5.784544909s
FAIL (2025-08-23 06:38:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 5.784578534s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
10 out of 60 is failed (threshold=3) [...X.............X.......X...X..X.X.X......X.X.............X] duration:
3.947528073s
FAIL (2025-08-23 06:38:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 06:38:21.212580473 (349h12m15.643660604s) [upload=363222]: Starting upload
Aug 23 06:38:21.212651899 (349h12m15.643732031s) [upload=363222]: Done starting upload
Aug 23 06:38:21.212742423 (349h12m15.643822554s) [upload=363222]: Uploading segments...
Aug 23 06:38:21.212905485 (349h12m15.643985616s) [upload=363222]: Got next segment. Inline: false
Aug 23 06:38:21.212947585 (349h12m15.644027717s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 06:38:21.212952795 (349h12m15.644032926s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 06:38:21.671061949 (349h12m16.10214208s) [seg_pos={0 0}, upload=363222]: Begin upload segment...
Aug 23 06:38:21.671099320 (349h12m16.102179451s) [seg_pos={0 0}, upload=363222]: Done begin upload segment.
Aug 23 06:38:21.671122725 (349h12m16.102202856s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671313890 (349h12m16.102394011s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671488835 (349h12m16.102568966s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671610608 (349h12m16.102690739s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671748582 (349h12m16.102828713s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671814248 (349h12m16.102894379s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.671955047 (349h12m16.103035178s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672011565 (349h12m16.103091696s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672175308 (349h12m16.103255439s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672275991 (349h12m16.103356122s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672475663 (349h12m16.103555794s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672489330 (349h12m16.103569461s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672717326 (349h12m16.103797467s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672736483 (349h12m16.103816614s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672930894 (349h12m16.104011086s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.672959048 (349h12m16.104039179s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673202344 (349h12m16.104282475s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:21.673231750 (349h12m16.104311881s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Uploading piece...
Aug 23 06:38:22.785276331 (349h12m17.216356452s) [upload=363222]: Next returned nil segment
Aug 23 06:38:22.785290868 (349h12m17.216371s) [upload=363222]: Waiting for error group managing segments...
Aug 23 06:38:23.066942936 (349h12m17.498023067s) [noise=true , address=79.127.205.235:4660 , piece_id=G5NZE6FU5M7DDGOQOROU5CQ7STC3MCPXMP42JR7URODK4R4KMIHQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.561570653 (349h12m17.992650784s) [noise=true , address=79.127.219.48:4103 , piece_id=L3YOJ4HNQQMZLT4UBVUCHKO6BS2Y2CZ7HIOKSV24JK6GYBFZLQSA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.575330652 (349h12m18.006410783s) [noise=true , address=79.127.219.51:4215 , piece_id=TH5ZSU5NMASL27MNZRKPB2UD7YJIAOZTDRWOJAXKAIHEZPBDNFNQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.582823559 (349h12m18.01390369s) [noise=true , address=104.36.82.51:4066 , piece_id=GTFSMB6GEX5YOJESOLTSC3YK2GRWTFZCDDO2TQEH5AM3TPKU5HRA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.584988662 (349h12m18.016068793s) [noise=true , address=77.90.31.12:4622 , piece_id=MGVIKSNI5M7H64V7SCL7QXJLOW3IFATWCM75WGE75MV52MR7F53Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.605915684 (349h12m18.036995815s) [noise=true , address=79.127.219.47:4070 , piece_id=5AAV2TQEGWTL7VWL4IE7OSPPS455W3NOLIX4XGVWHRXIFJJPA2NQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.609651512 (349h12m18.040731643s) [noise=true , address=79.127.201.215:4343 , piece_id=ILHBRZUXMIOXDVNJVWLNUOGLYT3545NWRZTNFMXG2YMZS3X6U2EA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.613563417 (349h12m18.044643548s) [noise=true , address=77.90.31.15:4707 , piece_id=KM6WVEV6KYBUVEWU5B5HAOQYFMOOF5PJ6BMHC7QUB5HNEDVU6KSQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.656001268 (349h12m18.087081399s) [noise=true , address=104.36.82.5:4844 , piece_id=HEA3TFV5VGFZ2IRZ4REIBXADYMRVSJW2OUEVEGDV6JUXXQ6XW3TQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657500327 (349h12m18.088580458s) [noise=true , address=77.90.31.18:4808 , piece_id=CXOE4JDPCZO2NPNK4TWJKATA3RSPV4PSX5PGFHKPNOFYKL5SR2LQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.657550603 (349h12m18.088630724s) [noise=true , address=104.36.82.37:4657 , piece_id=TXQYZ3DMV4LJCKAIQQJLFP6HNW44MYSHBFBLEJEWRPFBYVRWBGIQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693488046 (349h12m18.124568177s) [noise=true , address=104.36.82.23:4445 , piece_id=M6PFC4PCOI476UVHHIHU6PJWQX3EQDUB4RCPACTQB77Q5UYR4JPA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.693706334 (349h12m18.124786455s) [noise=true , address=104.36.82.20:4459 , piece_id=IYTWIYDZ7KBBAR6BMDR6DQGSEQIDTR33RAK2SDRZPX7J6ZMKGHCA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720630090 (349h12m18.151710221s) [noise=true , address=104.36.82.4:4817 , piece_id=OVBTCA2YRO2U64R5NTXIJAS7672XO4OP62ASWVCPB5TESMX6RDYA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: <nil>
Aug 23 06:38:23.720654336 (349h12m18.151734457s) [seg_pos={0 0}, upload=363222]: Segment reached optimal threshold of 14 pieces.
Aug 23 06:38:23.720771360 (349h12m18.151851491s) [noise=true , address=104.36.82.60:4362 , piece_id=LA3NBHOICABF3DVBJA7QWVOKEEGTKZOW766OBV4XUVXVLVK2552Q, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720802731 (349h12m18.151882862s) [noise=true , address=104.36.82.11:4144 , piece_id=6OFMUXI676XBUK4BOBP225LR44H33LBLXXNHCAJYT275Y2NPPJTQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128246NkJjT3UFiQdSqFssY6jTAV1jye3dXAjAkFnC3DUAXb235): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720815114 (349h12m18.151895235s) [noise=true , address=104.36.82.53:4140 , piece_id=GBGFDQVJTH2O6V4KZQ7FXIRGOASYVCJZD43AKSZWWYPYGUG5UHYQ, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Wv1U4bCkzg9Ywx4EKRkWG8tMffjwiVBEZ6tHr8scNHfdcWyrL): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720862745 (349h12m18.151942876s) [noise=true , address=77.90.31.10:4523 , piece_id=PJFYD7RH6Y7TDXM57L6XI6Z6C342ZBV7JL5C3MA7YIC2XL4GKWFA, seg_pos={0 0}, upload=363222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 23 06:38:23.720877413 (349h12m18.151957544s) [seg_pos={0 0}, upload=363222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 06:38:23.720932328 (349h12m18.152012459s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 06:38:23.720936436 (349h12m18.152016567s) [upload=363222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 06:38:24.058456874 (349h12m18.489537005s) [upload=363222]: Done uploading segments...
Aug 23 06:38:24.058475350 (349h12m18.489555481s) [upload=363222]: Upload finished. err: <nil>
Duration: 3.947554533s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X....................X..........] duration:
1.853265242s
FAIL (2025-08-23 06:38:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.853290432s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X....................X.........] duration:
2.080583488s
FAIL (2025-08-23 06:37:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.080599869s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [....X.............X.......X...X..X.X.X......X.X.............] duration:
5.707049669s
FAIL (2025-08-23 06:37:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:28:17.450972400 (349h2m11.882052531s) [upload=363039]: Starting upload Aug 23 06:28:17.451048075 (349h2m11.882128236s) [upload=363039]: Done starting upload Aug 23 06:28:17.451177784 (349h2m11.882257915s) [upload=363039]: Uploading segments... Aug 23 06:28:17.451336087 (349h2m11.882416218s) [upload=363039]: Got next segment. Inline: false Aug 23 06:28:17.451375311 (349h2m11.882455442s) [upload=363039]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:28:17.451381212 (349h2m11.882461343s) [upload=363039]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 06:28:17.668849299 (349h2m12.09992943s) [upload=363039]: Next segment err: metaclient: Too Many Requests Aug 23 06:28:17.668875980 (349h2m12.099956111s) [upload=363039]: Done uploading segments... Aug 23 06:28:17.668888884 (349h2m12.099969015s) [upload=363039]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.707090317s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X....................X........] duration:
1.931152533s
FAIL (2025-08-23 06:37:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.931179696s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X....................X.......] duration:
1.834746247s
FAIL (2025-08-23 06:36:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.834777056s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [.....X.............X.......X...X..X.X.X......X.X............] duration:
5.699043238s
FAIL (2025-08-23 06:36:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:28:17.450972400 (349h2m11.882052531s) [upload=363039]: Starting upload Aug 23 06:28:17.451048075 (349h2m11.882128236s) [upload=363039]: Done starting upload Aug 23 06:28:17.451177784 (349h2m11.882257915s) [upload=363039]: Uploading segments... Aug 23 06:28:17.451336087 (349h2m11.882416218s) [upload=363039]: Got next segment. Inline: false Aug 23 06:28:17.451375311 (349h2m11.882455442s) [upload=363039]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:28:17.451381212 (349h2m11.882461343s) [upload=363039]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 06:28:17.668849299 (349h2m12.09992943s) [upload=363039]: Next segment err: metaclient: Too Many Requests Aug 23 06:28:17.668875980 (349h2m12.099956111s) [upload=363039]: Done uploading segments... Aug 23 06:28:17.668888884 (349h2m12.099969015s) [upload=363039]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.699063516s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [......X.............X.......X...X..X.X.X......X.X...........] duration:
5.652040281s
FAIL (2025-08-23 06:35:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:28:17.450972400 (349h2m11.882052531s) [upload=363039]: Starting upload Aug 23 06:28:17.451048075 (349h2m11.882128236s) [upload=363039]: Done starting upload Aug 23 06:28:17.451177784 (349h2m11.882257915s) [upload=363039]: Uploading segments... Aug 23 06:28:17.451336087 (349h2m11.882416218s) [upload=363039]: Got next segment. Inline: false Aug 23 06:28:17.451375311 (349h2m11.882455442s) [upload=363039]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:28:17.451381212 (349h2m11.882461343s) [upload=363039]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 06:28:17.668849299 (349h2m12.09992943s) [upload=363039]: Next segment err: metaclient: Too Many Requests Aug 23 06:28:17.668875980 (349h2m12.099956111s) [upload=363039]: Done uploading segments... Aug 23 06:28:17.668888884 (349h2m12.099969015s) [upload=363039]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.652065811s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X....................X......] duration:
1.879266915s
FAIL (2025-08-23 06:35:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.879299568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
9 out of 60 is failed (threshold=3) [.......X.............X.......X...X..X.X.X......X.X..........] duration:
5.696084016s
FAIL (2025-08-23 06:34:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:28:17.450972400 (349h2m11.882052531s) [upload=363039]: Starting upload Aug 23 06:28:17.451048075 (349h2m11.882128236s) [upload=363039]: Done starting upload Aug 23 06:28:17.451177784 (349h2m11.882257915s) [upload=363039]: Uploading segments... Aug 23 06:28:17.451336087 (349h2m11.882416218s) [upload=363039]: Got next segment. Inline: false Aug 23 06:28:17.451375311 (349h2m11.882455442s) [upload=363039]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:28:17.451381212 (349h2m11.882461343s) [upload=363039]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 06:28:17.668849299 (349h2m12.09992943s) [upload=363039]: Next segment err: metaclient: Too Many Requests Aug 23 06:28:17.668875980 (349h2m12.099956111s) [upload=363039]: Done uploading segments... Aug 23 06:28:17.668888884 (349h2m12.099969015s) [upload=363039]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.696196582s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X....................X.....] duration:
1.865672553s
FAIL (2025-08-23 06:34:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.865701679s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
10 out of 60 is failed (threshold=3) [X.......X.............X.......X...X..X.X.X......X.X.........] duration:
5.623154065s
FAIL (2025-08-23 06:34:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:28:17.450972400 (349h2m11.882052531s) [upload=363039]: Starting upload Aug 23 06:28:17.451048075 (349h2m11.882128236s) [upload=363039]: Done starting upload Aug 23 06:28:17.451177784 (349h2m11.882257915s) [upload=363039]: Uploading segments... Aug 23 06:28:17.451336087 (349h2m11.882416218s) [upload=363039]: Got next segment. Inline: false Aug 23 06:28:17.451375311 (349h2m11.882455442s) [upload=363039]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:28:17.451381212 (349h2m11.882461343s) [upload=363039]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 06:28:17.668849299 (349h2m12.09992943s) [upload=363039]: Next segment err: metaclient: Too Many Requests Aug 23 06:28:17.668875980 (349h2m12.099956111s) [upload=363039]: Done uploading segments... Aug 23 06:28:17.668888884 (349h2m12.099969015s) [upload=363039]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.623180776s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
10 out of 60 is failed (threshold=3) [.X.......X.............X.......X...X..X.X.X......X.X........] duration:
5.829470962s
FAIL (2025-08-23 06:33:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:28:17.450972400 (349h2m11.882052531s) [upload=363039]: Starting upload Aug 23 06:28:17.451048075 (349h2m11.882128236s) [upload=363039]: Done starting upload Aug 23 06:28:17.451177784 (349h2m11.882257915s) [upload=363039]: Uploading segments... Aug 23 06:28:17.451336087 (349h2m11.882416218s) [upload=363039]: Got next segment. Inline: false Aug 23 06:28:17.451375311 (349h2m11.882455442s) [upload=363039]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:28:17.451381212 (349h2m11.882461343s) [upload=363039]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 06:28:17.668849299 (349h2m12.09992943s) [upload=363039]: Next segment err: metaclient: Too Many Requests Aug 23 06:28:17.668875980 (349h2m12.099956111s) [upload=363039]: Done uploading segments... Aug 23 06:28:17.668888884 (349h2m12.099969015s) [upload=363039]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.829499938s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.................................X....................X....] duration:
1.86140624s
FAIL (2025-08-23 06:33:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 06:30:58.255767762 (349h4m52.686847893s) [upload=363089]: Starting upload Aug 23 06:30:58.255817086 (349h4m52.686897217s) [upload=363089]: Done starting upload Aug 23 06:30:58.255880137 (349h4m52.686960268s) [upload=363089]: Uploading segments... Aug 23 06:30:58.255919553 (349h4m52.686999684s) [upload=363089]: Got next segment. Inline: true Aug 23 06:30:58.255923690 (349h4m52.687003821s) [upload=363089]: Waiting for error group managing segments... Aug 23 06:30:58.255958457 (349h4m52.687038578s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 06:30:58.255962444 (349h4m52.687042575s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 06:30:58.255965199 (349h4m52.68704533s) [upload=363089]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 06:30:58.471678279 (349h4m52.90275843s) [upload=363089]: Done uploading segments... Aug 23 06:30:58.471717283 (349h4m52.902797414s) [upload=363089]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.861434395s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|